00000001:02000400:3.0F:1789181118.434457:0:3299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789181139.697446:0:3520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789181142.313008:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 527 MB/s 00000001:01000000:0.0F:1789181142.564441:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 529 MB/s 00000001:01000000:0.0:1789181142.814572:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3507 MB/s 00000020:02000000:2.0F:1789181143.749116:0:3612:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g3d58bdf 00000400:02000000:0.0:1789181145.375901:0:3627:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.101@tcp [8/256/0/180] 00008000:02000000:2.0:1789181150.011907:0:3777:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789181219.983231:0:5748:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789181233.514389:0:6497:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789181233.514396:0:6497:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789181233.514398:0:6497:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789181233.514558:0:6497:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ebca1537 00000080:02000400:2.0:1789181233.514568:0:6497:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789181233.532248:0:6497:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789181233.533295:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789181233.534419:0:6497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002f6ad08d) 00000020:00000080:3.0:1789181233.534445:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789181233.592445:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789181233.593230:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789181233.632604:0:6497:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789181233.635606:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789181233.635740:0:6497:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789181233.635753:0:6497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283516ab6 00000020:01000004:1.0:1789181233.635762:0:6497:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789181233.635768:0:6497:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789181233.635773:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ebca1537 from MGS 00000020:01000004:1.0:1789181233.635778:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789181233.635800:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f83f2c2e) 00000020:00000080:1.0:1789181233.635812:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789181233.635893:0:6497:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ebca1537 from MGS, refs=2 00080000:01000000:1.0:1789181233.635899:0:6497:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789181233.635905:0:6497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283516ac4 00000100:00100000:1.0:1789181233.636016:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789181233.636334:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789181233.636341:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789181233.637522:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789181233.637533:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789181233.641546:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181233.641969:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789181233.641976:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789181233.642691:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789181233.645178:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789181233.646440:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789181233.646450:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789181233.647641:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181233.647646:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181233.647648:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181233.648142:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181233.648146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181233.648148:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181233.649075:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789181233.655935:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789181233.898789:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2347 MB/s 00000001:01000000:0.0:1789181234.150117:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3023 MB/s 00000001:01000000:0.0:1789181234.403166:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 438 MB/s 00000001:01000000:2.0:1789181234.655683:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 539 MB/s 00080000:10000000:2.0:1789181234.662420:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1789181234.675244:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789181234.676254:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789181234.676307:0:6497:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789181234.676358:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789181234.676516:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789181234.676550:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789181234.676932:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181234.677096:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789181234.677103:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789181234.686198:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789181234.686226:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789181234.692677:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789181234.692690:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789181234.693536:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789181234.693566:0:6497:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:0.0:1789181234.693568:0:6497:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789181234.693742:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:0.0:1789181234.693762:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (000000006107164d) 00000020:00000080:0.0:1789181234.693778:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789181234.693912:0:6497:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000147020c3@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1789181234.694106:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:0.0:1789181234.694114:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789181234.698447:0:6518:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789181234.698498:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid da575344-f445-48a7-8532-0e6efd2ea878) 00000020:00000080:0.0:1789181234.698520:0:6497:0:(genops.c:1384:class_connect()) connect: client da575344-f445-48a7-8532-0e6efd2ea878, cookie 0x76fb555283516ad2 00000100:00080000:0.0:1789181234.698533:0:6497:0:(import.c:545:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789181234.698544:0:6497:0:(import.c:666:import_select_connection()) MGC192.168.202.101@tcp: import 00000000147020c3 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181234.698596:0:6497:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000060eec7df x1876092408299648/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181234.698638:0:6497:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import da575344-f445-48a7-8532-0e6efd2ea878->MGS 00000020:01000004:0.0:1789181234.698657:0:6497:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789181234.698663:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789181234.698678:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e98c5535) 00000020:00000080:0.0:1789181234.698690:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1789181234.703020:0:6517:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1789181234.703149:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060eec7df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da575344-f445-48a7-8532-0e6efd2ea878:3642:1876092408299648:0@lo:250: 00000100:00100000:2.0:1789181234.703260:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181234.703337:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408299648 00000100:00100000:2.0:1789181234.703346:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408299648 00000100:00100000:2.0:1789181234.703390:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181234.703397:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe9bf2d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1876092408299648:12345-0@lo:250: 00010000:00080000:2.0:1789181234.703426:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from da575344-f445-48a7-8532-0e6efd2ea878@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1789181234.703454:0:6513:0:(genops.c:1384:class_connect()) connect: client da575344-f445-48a7-8532-0e6efd2ea878, cookie 0x76fb555283516ae0 00000100:00080000:2.0:1789181234.703601:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000d1677622 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181234.703656:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe9bf2d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+5:3642:x1876092408299648:12345-0@lo:250: Request processed in 258us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181234.703663:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181234.703711:0:3642:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789181234.703720:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.101@tcp: connect to target with instance 0 00000100:00080000:2.0:1789181234.703760:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789181234.703766:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789181234.703777:0:3642:0:(import.c:65:import_set_state_nolock()) 00000000147020c3 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789181234.703779:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789181234.703782:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789181234.703787:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060eec7df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da575344-f445-48a7-8532-0e6efd2ea878:3642:1876092408299648:0@lo:250: 00010000:00010000:2.0:1789181234.709148:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181234.716531:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789181234.719132:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789181234.719146:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789181234.719915:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789181234.719923:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789181234.721174:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789181234.721186:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789181234.722277:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789181234.722476:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789181234.722482:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789181234.724097:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789181234.724107:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789181234.792481:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181234.792933:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789181234.792942:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789181234.794583:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789181234.794597:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789181234.796420:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789181234.796601:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789181234.796607:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789181234.798336:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789181234.798350:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789181234.799365:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181234.799573:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789181234.799579:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789181234.800462:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789181234.800470:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789181234.801232:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789181234.801410:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789181234.801415:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789181234.802452:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789181234.802462:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789181234.852677:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181234.852959:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789181234.854336:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789181234.865284:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789181234.865307:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789181234.868673:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789181234.868692:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789181234.871231:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789181234.871257:0:6497:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789181234.871263:0:6497:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789181234.871370:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789181234.871398:0:6497:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789181234.871402:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789181234.871403:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789181234.871404:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181234.871405:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181234.871406:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181234.871407:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181234.871407:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789181234.871408:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789181234.871409:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789181234.871410:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789181234.871411:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181234.871412:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789181234.871413:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789181234.871417:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789181234.871418:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789181234.871418:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181234.871419:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181234.871420:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181234.871420:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181234.871421:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789181234.871421:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789181234.871432:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789181234.871433:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789181234.871433:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181234.871434:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789181234.871468:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789181234.871487:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e338aa69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408299776:0@lo:253: 00000100:00100000:3.0:1789181234.871568:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181234.871618:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000676ca8c9 going to sleep for 11 seconds 00000100:00100000:2.0:1789181234.871770:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408299776 00000100:00100000:2.0:1789181234.871779:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408299776 00000100:00100000:2.0:1789181234.871831:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181234.871839:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e106c303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+5:6497:x1876092408299776:12345-0@lo:253: 20000000:01000000:2.0:1789181234.871896:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789181234.871899:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789181234.872214:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789181234.872279:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789181234.872531:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789181234.873625:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789181234.873960:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789181234.873963:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789181234.873968:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789181234.873971:0:6516:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789181234.873979:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789181234.874145:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181234.874311:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789181234.874322:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789181234.874333:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789181234.874341:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789181234.874357:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789181234.874393:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789181234.874398:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789181234.874406:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789181234.874409:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789181234.874415:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789181234.874417:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789181234.874423:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789181234.874438:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789181234.874454:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789181234.874457:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789181234.874474:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181234.874531:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789181234.874537:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789181234.874546:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789181234.874553:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789181234.874560:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789181234.874565:0:6516:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789181234.874579:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789181234.874583:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789181234.874589:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789181234.874596:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789181234.874603:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789181234.874608:0:6516:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789181234.874624:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789181234.874644:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789181234.874659:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789181234.874692:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789181234.874773:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789181234.874794:0:6516:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789181234.874806:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789181234.875353:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789181234.875513:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789181234.875534:0:6516:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.101@tcp for mdt 20000000:01000000:2.0:1789181234.875536:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:2.0:1789181234.875550:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789181234.875556:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789181234.875568:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789181234.875581:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:2.0:1789181234.875595:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789181234.875603:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789181234.875625:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789181234.875642:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789181234.875669:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789181234.875673:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789181234.875676:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789181234.875714:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789181234.875716:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789181234.876423:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789181234.876594:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789181234.876685:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789181234.876720:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1789181234.876914:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789181234.876917:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789181234.877398:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789181234.877560:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789181234.877583:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789181234.877598:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789181234.877709:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789181234.877712:0:6516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789181234.877718:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789181234.877863:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789181234.877879:0:6516:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789181234.877885:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789181234.879583:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789181234.880267:0:6516:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789181234.889362:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1789181234.889394:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1789181234.889403:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1789181234.889420:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789181234.889437:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.889452:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.889475:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.889481:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.889487:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.889493:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.889499:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f1e228ab already unused, calling callback (0000000017e9db8a) 00010000:00010000:3.0:1789181234.889504:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.889511:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.889527:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.889532:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.889536:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f1e228ab/0x76fb555283516ae7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789181234.889553:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789181234.896453:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e106c303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+5:6497:x1876092408299776:12345-0@lo:253: Request processed in 24607us (24877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181234.896484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181234.896582:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e338aa69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408299776:0@lo:253: 10000000:01000000:2.0:1789181234.896598:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789181234.896600:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789181234.896602:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789181234.896607:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181234.896608:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789181234.896609:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181234.896620:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181234.896622:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181234.896623:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789181234.896624:0:6497:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789181234.896625:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181234.896626:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789181234.896645:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ebca1537 from lustre-MDT0000 10000000:01000000:2.0:1789181234.896679:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789181234.896682:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789181234.896687:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c1dd13ecd40 10000000:01000000:2.0:1789181234.896692:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789181234.896702:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c1dd13ecd40 from 1 10000000:01000000:2.0:1789181234.896704:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789181234.896795:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.896807:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.896816:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181234.896833:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408299904:0@lo:101: 00000100:00100000:2.0:1789181234.896860:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181234.896909:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408299904 00000100:00100000:0.0:1789181234.896917:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408299904 00000100:00100000:2.0:1789181234.896923:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a029e774 going to sleep for 11 seconds 00000100:00100000:0.0:1789181234.896959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181234.896969:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b53a34d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+5:6497:x1876092408299904:12345-0@lo:101: 00010000:00010000:0.0:1789181234.896982:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181234.896995:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e5a67f2/0x76fb555283516af5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516aee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181234.897019:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e5a67f2/0x76fb555283516af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516aee expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181234.897028:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e5a67f2/0x76fb555283516af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516aee expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181234.897037:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e5a67f2, rc 0) 00000100:00100000:0.0:1789181234.897085:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b53a34d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+6:6497:x1876092408299904:12345-0@lo:101: Request processed in 118us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181234.897091:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181234.897406:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408299904:0@lo:101: 00010000:00010000:2.0:1789181234.897419:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.897428:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181234.897485:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300032:0@lo:501: 00000100:00100000:2.0:1789181234.897512:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181234.897562:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a029e774 going to sleep for 11 seconds 00000100:00100000:3.0:1789181234.897586:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408300032 00000100:00100000:3.0:1789181234.897590:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408300032 00000100:00100000:3.0:1789181234.897674:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181234.897682:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054489f2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+6:6497:x1876092408300032:12345-0@lo:501: 00000100:00100000:3.0:1789181234.897849:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054489f2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+6:6497:x1876092408300032:12345-0@lo:501: Request processed in 168us (336us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789181234.897857:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181234.897973:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300032:0@lo:501: 10000000:01000000:2.0:1789181234.898001:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789181234.898085:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.898094:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181234.898102:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c1dc32aa000 10000000:01000000:2.0:1789181234.898107:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789181234.898111:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c1dc32aa000 10000000:01000000:2.0:1789181234.898114:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789181234.898117:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c1dc32aa000 from 1 10000000:01000000:2.0:1789181234.898119:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789181234.898138:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000b02e4907/0x76fb555283516afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.898144:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000b02e4907/0x76fb555283516afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.898151:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000b02e4907/0x76fb555283516afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181234.898163:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300160:0@lo:101: 00000100:00100000:2.0:1789181234.898201:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181234.898262:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a029e774 going to sleep for 11 seconds 00000100:00100000:3.0:1789181234.898291:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408300160 00000100:00100000:3.0:1789181234.898296:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408300160 00000100:00100000:3.0:1789181234.898326:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181234.898333:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000039984b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+6:6497:x1876092408300160:12345-0@lo:101: 00010000:00010000:3.0:1789181234.898341:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181234.898354:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000031346ce/0x76fb555283516b03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516afc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.898370:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000031346ce/0x76fb555283516b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516afc expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.898378:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000031346ce/0x76fb555283516b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516afc expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181234.898383:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000031346ce, rc 0) 00000100:00100000:3.0:1789181234.898458:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000039984b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+7:6497:x1876092408300160:12345-0@lo:101: Request processed in 126us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181234.898464:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181234.898511:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300160:0@lo:101: 00010000:00010000:2.0:1789181234.898521:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000b02e4907/0x76fb555283516afc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.898529:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000b02e4907/0x76fb555283516afc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181234.898541:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789181234.898583:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000b02e4907/0x76fb555283516afc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.898590:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000b02e4907/0x76fb555283516afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181234.898596:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789181234.898599:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789181234.898603:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c1dc32aa000 10000000:01000000:2.0:1789181234.898606:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789181234.898608:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789181234.898610:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789181234.898632:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.898639:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.898646:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181234.898663:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300288:0@lo:101: 00000100:00100000:2.0:1789181234.898688:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181234.898708:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a029e774 going to sleep for 11 seconds 00000100:00100000:0.0:1789181234.898968:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408300288 00000100:00100000:0.0:1789181234.898974:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408300288 00000100:00100000:0.0:1789181234.899013:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181234.899020:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb0106fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+7:6497:x1876092408300288:12345-0@lo:101: 00010000:00010000:0.0:1789181234.899027:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181234.899035:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000caa1322c/0x76fb555283516b11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516b0a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181234.899049:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000caa1322c/0x76fb555283516b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516b0a expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181234.899057:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000caa1322c/0x76fb555283516b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516b0a expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181234.899063:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000caa1322c, rc 0) 00000100:00100000:0.0:1789181234.899106:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb0106fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+8:6497:x1876092408300288:12345-0@lo:101: Request processed in 86us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181234.899112:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181234.899438:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300288:0@lo:101: 00010000:00010000:2.0:1789181234.899449:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181234.899456:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181234.899505:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300416:0@lo:501: 00000100:00100000:2.0:1789181234.899532:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181234.899559:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a029e774 going to sleep for 11 seconds 00000100:00100000:0.0:1789181234.899763:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408300416 00000100:00100000:0.0:1789181234.899768:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408300416 00000100:00100000:0.0:1789181234.899801:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181234.899808:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005297a3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+8:6497:x1876092408300416:12345-0@lo:501: 00000100:00100000:0.0:1789181234.899943:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005297a3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+9:6497:x1876092408300416:12345-0@lo:501: Request processed in 134us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181234.899950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789181234.900163:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300416:0@lo:501: 00000100:00100000:2.0:1789181234.900193:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300544:0@lo:503: 00000100:00100000:2.0:1789181234.900243:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181234.900267:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a029e774 going to sleep for 11 seconds 00000100:00100000:3.0:1789181234.900939:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408300544 00000100:00100000:3.0:1789181234.900946:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408300544 00000100:00100000:3.0:1789181234.900987:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181234.900993:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac9f0431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+9:6497:x1876092408300544:12345-0@lo:503: 00000100:00100000:3.0:1789181234.901109:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac9f0431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+9:6497:x1876092408300544:12345-0@lo:503: Request processed in 116us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181234.901117:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181234.901158:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300544:0@lo:503: 00000100:00100000:2.0:1789181234.901787:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:6543:1876092408300672:0@lo:502: 00000100:00100000:2.0:1789181234.901831:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181234.901881:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c455563 going to sleep for 11 seconds 00000100:00100000:3.0:1789181234.902237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408300672 00000100:00100000:3.0:1789181234.902243:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408300672 00000100:00100000:3.0:1789181234.902274:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181234.902280:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000027f0d22a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+9:6543:x1876092408300672:12345-0@lo:502: 00000100:00100000:3.0:1789181234.902370:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000027f0d22a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+9:6543:x1876092408300672:12345-0@lo:502: Request processed in 90us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181234.902377:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789181234.902381:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:6543:1876092408300672:0@lo:502: 00000020:01000000:2.0:1789181234.902404:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181234.902416:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181234.902423:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789181234.902429:0:6543:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789181234.902432:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789181234.902451:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000be0ea4d9) 00000020:00000080:2.0:1789181234.902470:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789181234.902476:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789181234.902552:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789181234.902561:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283516b1f 00000020:00000080:2.0:1789181234.902830:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789181234.902835:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181234.902839:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181234.902840:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789181234.902843:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181234.902846:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181234.902847:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789181234.902863:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789181234.903131:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000965f81e0) 00000020:00000080:2.0:1789181234.903144:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789181234.903149:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789181234.903151:0:6543:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789181234.903153:0:6543:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789181234.903160:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789181234.903216:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ebca1537 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789181234.903227:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000abd52323) 00000020:00000080:2.0:1789181234.903236:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789181234.903308:0:6543:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789181234.903313:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb555283516b34 00000020:00000080:2.0:1789181234.903414:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789181234.903420:0:6543:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789181234.903424:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x76fb555283516b3b 00080000:01000000:2.0:1789181234.903429:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789181234.903432:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283516b42 00080000:10000000:2.0:1789181234.903863:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789181234.904496:0:6543:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789181234.910982:0:6543:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789181234.991473:0:6543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789181234.992058:0:6543:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789181234.995005:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789181234.995470:0:6543:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789181234.999438:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000005d35344c) 00000020:00000080:3.0:1789181234.999465:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789181234.999554:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789181234.999562:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283516b50 00000020:00000080:3.0:1789181235.000370:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789181235.001219:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1789181235.004127:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1789181235.012091:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1789181235.019042:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1789181235.045110:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1789181235.049854:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1789181235.054510:0:6543:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x76fb555283516b57 00000020:00000080:1.0:1789181235.055036:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789181235.055049:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181235.055055:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181235.055058:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789181235.055061:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181235.055066:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181235.055067:0:6543:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789181235.055070:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789181235.055072:0:6543:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789181235.055074:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181235.055076:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181235.055077:0:6543:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789181235.055079:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181235.055085:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181235.055086:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789181235.055091:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789181235.055145:0:6543:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789181235.055241:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5cd1c81 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:6543:1876092408300800:0@lo:502: 00000100:00100000:1.0:1789181235.055335:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181235.055584:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408300800 00000100:00100000:1.0:1789181235.055585:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061a470f3 going to sleep for 11 seconds 00000100:00100000:3.0:1789181235.055592:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408300800 00000100:00100000:3.0:1789181235.055834:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181235.055844:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3c8255e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+9:6543:x1876092408300800:12345-0@lo:502: 00000100:00100000:3.0:1789181235.055984:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3c8255e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+9:6543:x1876092408300800:12345-0@lo:502: Request processed in 142us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181235.055992:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181235.057695:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5cd1c81 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:6543:1876092408300800:0@lo:502: 00000020:01000000:1.0:1789181235.057790:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181235.057799:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181235.057801:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789181235.057805:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789181235.058363:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789181235.058387:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789181235.058408:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181235.058420:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181235.058428:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1dc32aa000 from 1 10000000:01000000:3.0:1789181235.058430:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789181235.058530:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181235.058537:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181235.058546:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181235.058566:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4cdbfee pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300928:0@lo:101: 00000100:00100000:3.0:1789181235.058621:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181235.058913:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c099b922 going to sleep for 11 seconds 00000100:00100000:0.0:1789181235.058964:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408300928 00000100:00100000:0.0:1789181235.058973:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408300928 00000100:00100000:0.0:1789181235.059034:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181235.059045:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000119c0fba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+9:6497:x1876092408300928:12345-0@lo:101: 00010000:00010000:0.0:1789181235.059058:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181235.059071:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6455a37/0x76fb555283516b65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516b5e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.059093:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6455a37/0x76fb555283516b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516b5e expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.059103:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6455a37/0x76fb555283516b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516b5e expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.059112:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6455a37, rc 0) 00000100:00100000:0.0:1789181235.059162:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000119c0fba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+10:6497:x1876092408300928:12345-0@lo:101: Request processed in 119us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181235.059169:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181235.059216:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4cdbfee pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408300928:0@lo:101: 00010000:00010000:3.0:1789181235.059229:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181235.059245:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181235.059851:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4cdbfee pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301056:0@lo:256: 00000100:00100000:3.0:1789181235.059907:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181235.059943:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c099b922 going to sleep for 11 seconds 00000100:00100000:2.0:1789181235.060229:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408301056 00000100:00100000:2.0:1789181235.060236:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408301056 00000100:00100000:2.0:1789181235.060282:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181235.060290:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000716fb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+10:6497:x1876092408301056:12345-0@lo:256: 20000000:01000000:2.0:1789181235.060305:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789181235.060311:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789181235.060394:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000716fb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+10:6497:x1876092408301056:12345-0@lo:256: Request processed in 105us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181235.060400:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181235.060617:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4cdbfee pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301056:0@lo:256: 10000000:01000000:3.0:1789181235.063358:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789181235.063385:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181235.063399:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181235.063408:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dc32aa000 from 1 10000000:01000000:3.0:1789181235.063411:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181235.063455:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181235.063463:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181235.063474:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181235.063496:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4cdbfee pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301184:0@lo:101: 00000100:00100000:3.0:1789181235.063564:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181235.063692:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c099b922 going to sleep for 11 seconds 00000100:00100000:2.0:1789181235.067851:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408301184 00000100:00100000:2.0:1789181235.067880:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408301184 00000100:00100000:2.0:1789181235.067995:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789181235.068006:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000582505b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+10:6497:x1876092408301184:12345-0@lo:101: 00010000:00010000:2.0:1789181235.068038:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181235.068062:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000588113e7/0x76fb555283516b73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516b6c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.068090:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000588113e7/0x76fb555283516b73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516b6c expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.068100:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000588113e7/0x76fb555283516b73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516b6c expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.068108:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000588113e7, rc 0) 00000100:00100000:2.0:1789181235.068193:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000582505b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+11:6497:x1876092408301184:12345-0@lo:101: Request processed in 189us (4629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181235.068199:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181235.068231:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4cdbfee pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301184:0@lo:101: 00010000:00010000:0.0:1789181235.068248:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.068257:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181235.068342:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006eeada79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301312:0@lo:501: 00000100:00100000:0.0:1789181235.068390:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181235.072824:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408301312 00000100:00100000:3.0:1789181235.072843:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408301312 00000100:00100000:3.0:1789181235.072922:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789181235.072932:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e07bcd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+11:6497:x1876092408301312:12345-0@lo:501: 00000100:00100000:3.0:1789181235.073303:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e07bcd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+11:6497:x1876092408301312:12345-0@lo:501: Request processed in 372us (4912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181235.073313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181235.074189:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a687a9f going to sleep for 11 seconds 00000100:00100000:0.0:1789181235.074225:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006eeada79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301312:0@lo:501: 00000100:00100000:0.0:1789181235.074294:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006eeada79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301440:0@lo:503: 00000100:00100000:0.0:1789181235.074355:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181235.074383:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a687a9f going to sleep for 11 seconds 00000100:00100000:3.0:1789181235.074436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408301440 00000100:00100000:3.0:1789181235.074441:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408301440 00000100:00100000:3.0:1789181235.074486:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181235.074493:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e69d82dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+11:6497:x1876092408301440:12345-0@lo:503: 00000040:00080000:3.0:1789181235.074534:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181235.074588:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e69d82dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+11:6497:x1876092408301440:12345-0@lo:503: Request processed in 96us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181235.074595:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181235.074896:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006eeada79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301440:0@lo:503: 00000040:00080000:1.0:1789181235.075928:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789181235.076435:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789181235.076461:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181235.076477:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181235.076490:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181235.076545:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789181235.076548:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c1dc32aa000 10000000:01000000:3.0:1789181235.076550:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c1dc32aa000 10000000:01000000:3.0:1789181235.076554:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789181235.076561:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1dc32aa000 from 1 10000000:01000000:3.0:1789181235.076588:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789181235.076623:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181235.076630:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181235.076641:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181235.076660:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e3cfa2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301568:0@lo:101: 00000100:00100000:3.0:1789181235.076750:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181235.076786:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a072c07d going to sleep for 11 seconds 00000100:00100000:1.0:1789181235.076948:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408301568 00000100:00100000:1.0:1789181235.076956:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408301568 00000100:00100000:1.0:1789181235.077005:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181235.077014:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e221eb0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+11:6497:x1876092408301568:12345-0@lo:101: 00010000:00010000:1.0:1789181235.077027:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181235.077040:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a52620bc/0x76fb555283516b81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516b7a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181235.077065:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a52620bc/0x76fb555283516b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516b7a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181235.077075:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a52620bc/0x76fb555283516b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516b7a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181235.077082:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a52620bc, rc 0) 00000100:00100000:1.0:1789181235.077133:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e221eb0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+12:6497:x1876092408301568:12345-0@lo:101: Request processed in 120us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181235.077139:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789181235.077220:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e3cfa2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301568:0@lo:101: 00010000:00010000:0.0:1789181235.077233:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.077240:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181235.077293:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e485715d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301696:0@lo:501: 00000100:00100000:0.0:1789181235.077326:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181235.077354:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000201fa82f going to sleep for 11 seconds 00000100:00100000:3.0:1789181235.077398:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408301696 00000100:00100000:3.0:1789181235.077403:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408301696 00000100:00100000:3.0:1789181235.077435:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789181235.077442:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aaab21f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:6497:x1876092408301696:12345-0@lo:501: 00000100:00100000:3.0:1789181235.077596:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aaab21f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:6497:x1876092408301696:12345-0@lo:501: Request processed in 154us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181235.077603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789181235.077838:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e485715d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301696:0@lo:501: 00000100:00100000:0.0:1789181235.077881:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e485715d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301824:0@lo:503: 00000100:00100000:0.0:1789181235.077928:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181235.077955:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000201fa82f going to sleep for 11 seconds 00000100:00100000:1.0:1789181235.078175:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408301824 00000100:00100000:1.0:1789181235.078180:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408301824 00000100:00100000:3.0:1789181235.078277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789181235.078286:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cb773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:6497:x1876092408301824:12345-0@lo:503: 00000100:00100000:3.0:1789181235.078421:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cb773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:6497:x1876092408301824:12345-0@lo:503: Request processed in 136us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181235.078428:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789181235.078606:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e485715d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408301824:0@lo:503: 00000100:00100000:2.0:1789181235.080166:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:6548:1876092408301952:0@lo:502: 00000100:00100000:2.0:1789181235.080246:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181235.080296:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408301952 00000100:00100000:1.0:1789181235.080304:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408301952 00000100:00100000:2.0:1789181235.080313:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set 00000000676ca8c9 going to sleep for 11 seconds 00000100:00100000:1.0:1789181235.080367:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789181235.080375:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000554a2035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+12:6548:x1876092408301952:12345-0@lo:502: 00000100:00100000:1.0:1789181235.080479:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000554a2035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+12:6548:x1876092408301952:12345-0@lo:502: Request processed in 104us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181235.080486:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789181235.080503:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d9e0eff pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:6548:1876092408301952:0@lo:502: 00000020:01000004:2.0:1789181235.080600:0:6548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789181235.080620:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007f75e42d) 00000020:00000080:2.0:1789181235.080646:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789181235.081245:0:6548:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ebca1537 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789181235.081250:0:6548:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ebca1537 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789181235.081253:0:6548:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ebca1537 4 00010000:00080000:2.0:1789181235.081290:0:6548:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a5d65eaf@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1789181235.087995:0:6548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789181235.088443:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789181235.088496:0:6548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789181235.088516:0:6548:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x76fb555283516b8f 00000100:00080000:3.0:1789181235.088528:0:6548:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789181235.088539:0:6548:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a5d65eaf using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181235.088581:0:6548:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000532e439e x1876092408302080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789181235.088612:0:6548:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789181235.089045:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000532e439e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876092408302080:0@lo:38: 00000100:00100000:2.0:1789181235.089118:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181235.089381:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000054b72a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:6548:1876092408302208:0@lo:502: 00000100:00100000:3.0:1789181235.089427:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181235.089450:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c118fb7 going to sleep for 11 seconds 00000100:00100000:2.0:1789181235.089555:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408302208 00000100:00100000:2.0:1789181235.089562:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408302208 00000100:00100000:2.0:1789181235.089618:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789181235.089636:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000407dc458 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:6548:x1876092408302208:12345-0@lo:502: 00000100:00100000:2.0:1789181235.089812:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000407dc458 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:6548:x1876092408302208:12345-0@lo:502: Request processed in 187us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181235.089821:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789181235.090194:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000054b72a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:6548:1876092408302208:0@lo:502: 00000040:00080000:3.0:1789181235.090222:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789181235.091882:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789181235.091915:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181235.091943:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.091956:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789181235.092151:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789181235.092153:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789181235.092155:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181235.092156:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181235.092157:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181235.092159:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181235.092160:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181235.092161:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789181235.092163:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181235.092165:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181235.092166:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181235.092167:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181235.092171:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789181235.092174:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181235.092175:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789181235.092176:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181235.092177:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181235.092178:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181235.092179:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181235.092180:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181235.092181:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789181235.092182:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181235.092183:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181235.092184:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181235.092185:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181235.092210:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789181235.092227:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c10555d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408302336:0@lo:253: 00000100:00100000:2.0:1789181235.092290:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181235.092334:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408302336 00000100:00100000:2.0:1789181235.092340:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408302336 00000100:00100000:2.0:1789181235.092386:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789181235.092394:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9a21f96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+12:6497:x1876092408302336:12345-0@lo:253: 20000000:01000000:2.0:1789181235.092420:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789181235.092433:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789181235.093376:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000676ca8c9 going to sleep for 11 seconds 00000100:00100000:0.0:1789181235.096354:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408302080 00000100:00100000:0.0:1789181235.096374:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408302080 00000100:00100000:0.0:1789181235.096426:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181235.096434:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d9e0eff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876092408302080:12345-0@lo:38: 00000100:00100000:0.0:1789181235.096544:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d9e0eff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876092408302080:12345-0@lo:38: Request processed in 109us (7425us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789181235.096551:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181235.097863:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181235.097889:0:3642:0:(import.c:65:import_set_state_nolock()) 00000000a5d65eaf lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789181235.097900:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789181235.097904:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000532e439e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876092408302080:0@lo:38: 20000000:01000000:2.0:1789181235.104262:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789181235.104283:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789181235.104589:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9a21f96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+12:6497:x1876092408302336:12345-0@lo:253: Request processed in 12191us (12294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181235.104608:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789181235.104757:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c10555d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:6497:1876092408302336:0@lo:253: 10000000:01000000:3.0:1789181235.104773:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789181235.104777:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789181235.104780:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789181235.104781:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181235.104782:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181235.104783:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181235.104784:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181235.104785:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789181235.104786:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789181235.104787:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789181235.104789:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789181235.104790:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181235.104792:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789181235.104806:0:6497:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789181235.109798:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789181235.109810:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789181235.109837:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.109884:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d6455a37/0x76fb555283516b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516b5e expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.109893:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.109942:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d6455a37/0x76fb555283516b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516b5e expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.109959:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d6455a37/0x76fb555283516b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516b5e expref: 11 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181235.109973:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e485715d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408302464:0@lo:104: 00000100:00100000:0.0:1789181235.110055:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181235.110115:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8403d2e going to sleep for 11 seconds 00000100:00100000:2.0:1789181235.110248:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408302464 00000100:00100000:2.0:1789181235.110258:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408302464 00000100:00100000:2.0:1789181235.110311:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181235.110320:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c2bfc986 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:6537:x1876092408302464:12345-0@lo:104: 00010000:00010000:2.0:1789181235.110332:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.110394:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789181235.110400:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c2bfc986 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:6537:x1876092408302464:12345-0@lo:104: Request processed in 82us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181235.110407:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181235.110447:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e485715d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408302464:0@lo:104: 00010000:00010000:2.0:1789181235.110464:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.110898:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181235.110905:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.110913:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a0d26e41 already unused, calling callback (00000000517fa998) 10000000:00010000:2.0:1789181235.110916:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.110923:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181235.110938:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181235.110944:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181235.110984:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.110991:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181235.111023:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.111030:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000a0d26e41/0x76fb555283516b5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b65 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.111047:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181235.111049:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181235.111050:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181235.115926:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098d1a3db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408302592:0@lo:103: 00000100:00100000:2.0:1789181235.116126:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1789181235.120966:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789181235.121319:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789181235.121535:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1789181235.122080:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408302592 00000100:00100000:0.0:1789181235.122094:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408302592 00010000:00010000:0.0:1789181235.122134:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d6455a37/0x76fb555283516b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516b5e expref: 12 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181235.122176:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181235.122186:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b7d1550 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+12:3644:x1876092408302592:12345-0@lo:103: 00010000:00010000:0.0:1789181235.122199:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181235.122205:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d6455a37/0x76fb555283516b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516b5e expref: 12 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122217:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d6455a37/0x76fb555283516b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516b5e expref: 12 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122246:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d6455a37/0x76fb555283516b65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516b5e expref: 12 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122262:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122270:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789181235.122296:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012487745s 00010000:00010000:0.0:1789181235.122301:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122307:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122313:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122319:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122325:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004ba551a4 already unused, calling callback (0000000017e9db8a) 00010000:00010000:0.0:1789181235.122328:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122335:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122357:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181235.122376:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181235.122451:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b7d1550 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+11:3644:x1876092408302592:12345-0@lo:103: Request processed in 267us (6326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181235.122458:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:3.0:1789181235.123359:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789181235.124309:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1789181235.124501:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:2.0:1789181235.125338:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.125356:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181235.125364:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004ba551a4/0x76fb555283516b96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181235.125441:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098d1a3db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408302592:0@lo:103: 00080000:10000000:3.0:1789181235.137451:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1789181235.141371:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789181235.143281:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1789181235.143518:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789181235.143783:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1789181235.146276:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1789181235.154886:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789181235.173486:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789181235.173603:0:6553:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789181235.173607:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789181235.174341:0:6554:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789181235.176581:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789181235.176970:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789181235.177964:0:6497:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789181235.177979:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789181235.178416:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181235.188065:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789181235.189536:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789181235.189605:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789181235.191442:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789181235.191943:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:3.0:1789181235.195847:0:6554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1789181235.202493:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789181235.202661:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789181235.202911:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789181235.203582:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789181235.203781:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789181235.203926:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789181235.205337:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789181235.205483:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789181235.205612:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789181235.209398:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789181235.209612:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789181235.211351:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789181235.211480:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789181235.211606:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000040:00080000:2.0:1789181235.212472:0:6554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789181235.212556:0:6554:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789181235.212560:0:6554:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1789181235.213409:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789181235.213573:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789181235.215171:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789181235.215448:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789181235.215580:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789181235.216152:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789181235.216372:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789181235.216572:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789181235.217355:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789181235.217531:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789181235.218297:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789181235.218520:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789181235.219476:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789181235.219676:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789181235.220197:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789181235.220436:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789181235.220577:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789181235.221450:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789181235.222279:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789181235.227431:0:6497:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789181235.227485:0:6497:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa94541c7b988 00100000:10000000:0.0:1789181235.227496:0:6497:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789181235.228621:0:6497:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789181235.229155:0:6497:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789181235.229177:0:6497:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789181235.229274:0:6497:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789181235.231595:0:6497:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789181235.231860:0:6497:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789181235.727674:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181236.748905:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181237.774409:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181238.797110:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181239.821137:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789181239.916362:0:6798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789181240.589835:0:63:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789181240.589846:0:63:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789181240.589849:0:63:0:(import.c:65:import_set_state_nolock()) 00000000a5d65eaf lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789181240.589867:0:63:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a5d65eaf using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181240.589891:0:63:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000054b72a5 x1876092408302848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789181240.590010:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000532e439e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408302720:0@lo:400: 00000100:00100000:3.0:1789181240.590078:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181240.590169:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000054b72a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876092408302848:0@lo:38: 00000100:00100000:3.0:1789181240.590205:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181240.590252:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408302720 00000100:00100000:3.0:1789181240.590260:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408302720 00000100:00100000:3.0:1789181240.590302:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789181240.590310:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4e2221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+11:3645:x1876092408302720:12345-0@lo:400: 00000100:00100000:3.0:1789181240.590469:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4e2221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+11:3645:x1876092408302720:12345-0@lo:400: Request processed in 160us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181240.590476:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789181240.590519:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000532e439e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408302720:0@lo:400: 00000100:00100000:1.0:1789181240.592848:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408302848 00000100:00100000:1.0:1789181240.592863:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408302848 00000100:00100000:1.0:1789181240.592953:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181240.592960:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d3655a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876092408302848:12345-0@lo:38: 00010000:00080000:1.0:1789181240.592990:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:1.0:1789181240.593048:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x76fb555283516b9d 00000004:00100000:1.0:1789181240.593096:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789181240.593245:0:6523:0:(import.c:65:import_set_state_nolock()) 000000009a04ce29 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181240.593415:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d3655a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876092408302848:12345-0@lo:38: Request processed in 453us (3209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181240.593422:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789181240.597813:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000054b72a5 x1876092408302848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789181240.597851:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789181240.597861:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789181240.597866:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789181240.597869:0:3642:0:(import.c:65:import_set_state_nolock()) 00000000a5d65eaf lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789181240.597876:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000054b72a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876092408302848:0@lo:38: 00010000:00010000:3.0:1789181240.846132:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789181240.942163:0:6850:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789181240.944202:0:6850:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789181241.867822:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789181242.125064:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789181242.125076:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1dc32aa000 from 3 10000000:01000000:1.0:1789181242.125081:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789181242.125159:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181242.125176:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181242.125191:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181242.125222:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5cd1c81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408302976:0@lo:101: 00000100:00100000:1.0:1789181242.125310:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181242.125398:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000009319986b going to sleep for 11 seconds 00000100:00100000:2.0:1789181242.129300:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408302976 00000100:00100000:2.0:1789181242.129319:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408302976 00000100:00100000:2.0:1789181242.129392:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789181242.129402:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf05c104 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+11:6518:x1876092408302976:12345-0@lo:101: 00010000:00010000:2.0:1789181242.129423:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181242.129441:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a38ebea9/0x76fb555283516bab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516ba4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181242.129470:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a38ebea9/0x76fb555283516bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516ba4 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181242.129481:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a38ebea9/0x76fb555283516bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ba4 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181242.129490:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a38ebea9, rc 0) 00000100:00100000:2.0:1789181242.129575:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf05c104 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+12:6518:x1876092408302976:12345-0@lo:101: Request processed in 174us (4266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181242.129599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181242.129914:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5cd1c81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408302976:0@lo:101: 00010000:00010000:1.0:1789181242.129934:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181242.129943:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181242.130010:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5cd1c81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408303104:0@lo:256: 00000100:00100000:1.0:1789181242.130055:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181242.130098:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000009319986b going to sleep for 11 seconds 00000100:00100000:2.0:1789181242.130218:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408303104 00000100:00100000:2.0:1789181242.130223:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408303104 00000100:00100000:2.0:1789181242.130261:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181242.130268:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f28442b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:6518:x1876092408303104:12345-0@lo:256: 20000000:01000000:2.0:1789181242.130282:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789181242.130297:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789181242.130300:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789181242.130388:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f28442b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:6518:x1876092408303104:12345-0@lo:256: Request processed in 120us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181242.130396:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789181242.130470:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5cd1c81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408303104:0@lo:256: 10000000:01000000:3.0:1789181242.130517:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789181242.130523:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181242.130531:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181242.894085:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789181243.824672:0:6952:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789181243.825151:0:6952:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789181243.916859:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181244.940880:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181245.710126:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181245.710164:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000054b72a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408303232:0@lo:400: 00000100:00100000:3.0:1789181245.710240:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181245.710293:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000532e439e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408303360:0@lo:400: 00000100:00100000:3.0:1789181245.710321:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181245.710358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408303232 00000100:00100000:3.0:1789181245.710366:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408303232 00000100:00100000:3.0:1789181245.710414:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789181245.710421:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cac1f2e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+12:3645:x1876092408303232:12345-0@lo:400: 00000100:00100000:3.0:1789181245.710469:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cac1f2e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+12:3645:x1876092408303232:12345-0@lo:400: Request processed in 48us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181245.710476:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789181245.710515:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408303360 00000100:00100000:3.0:1789181245.710519:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408303360 00000100:00100000:3.0:1789181245.710542:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181245.710548:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6f2f6af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408303360:12345-0@lo:400: 00000100:00100000:3.0:1789181245.710583:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6f2f6af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408303360:12345-0@lo:400: Request processed in 36us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181245.710589:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181245.710622:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000054b72a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408303232:0@lo:400: 00010000:00080000:3.0:1789181245.710651:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000532e439e x1876092408303360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181245.710663:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000532e439e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408303360:0@lo:400: 00010000:00010000:1.0:1789181245.963825:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181246.987898:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181248.019009:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181249.036021:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181250.060399:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181250.828003:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000532e439e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408303488:0@lo:400: 00000100:00100000:3.0:1789181250.828079:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181250.828177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408303488 00000100:00100000:3.0:1789181250.828185:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408303488 00000100:00100000:3.0:1789181250.828236:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789181250.828244:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc2741bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+12:3644:x1876092408303488:12345-0@lo:400: 00000100:00100000:3.0:1789181250.828296:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc2741bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+12:3644:x1876092408303488:12345-0@lo:400: Request processed in 53us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181250.828303:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789181250.828350:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000532e439e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408303488:0@lo:400: 00000100:00100000:1.0:1789181250.828419:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000054b72a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408303616:0@lo:400: 00000100:00100000:1.0:1789181250.828460:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181250.828696:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408303616 00000100:00100000:3.0:1789181250.828701:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408303616 00000100:00100000:3.0:1789181250.828765:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181250.828772:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000adcb1e5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408303616:12345-0@lo:400: 00000100:00100000:3.0:1789181250.828810:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000adcb1e5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408303616:12345-0@lo:400: Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181250.828816:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789181250.828831:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000054b72a5 x1876092408303616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181250.828845:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000054b72a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408303616:0@lo:400: 00010000:00010000:3.0:1789181251.084998:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181252.109414:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181253.133113:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789181254.153152:0:7450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789181254.153156:0:7450:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789181254.153157:0:7450:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789181254.153228:0:7450:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000e4ad5cf 00000020:01000004:0.0:1789181254.153242:0:7450:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1789181254.153261:0:7450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789181254.153272:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000b69d4744) 00000020:00000080:0.0:1789181254.153284:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1789181254.179512:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789181254.227454:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789181254.227575:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1789181254.284566:0:7450:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789181254.284861:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789181254.284873:0:7450:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789181254.284886:0:7450:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb555283516bb9 00000020:01000004:2.0:1789181254.284893:0:7450:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789181254.284917:0:7450:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789181254.284921:0:7450:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789181254.284928:0:7450:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789181254.285069:0:7450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789181254.285073:0:7450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789181254.326227:0:7450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789181254.326271:0:7450:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789181254.326275:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789181254.326281:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789181254.326282:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181254.326283:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181254.326284:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181254.326285:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181254.326286:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181254.326287:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181254.326288:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181254.326290:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181254.326291:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181254.326294:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789181254.326297:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181254.326298:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789181254.326299:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181254.326299:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181254.326300:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181254.326301:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181254.326302:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181254.326303:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181254.326303:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181254.326304:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181254.326305:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181254.326332:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789181254.326350:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098d1a3db pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408303744:0@lo:253: 00000100:00100000:2.0:1789181254.326422:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.326486:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408303744 00000100:00100000:1.0:1789181254.326494:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408303744 00000100:00100000:1.0:1789181254.326544:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789181254.326551:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb630a6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:7450:x1876092408303744:12345-0@lo:253: 20000000:01000000:1.0:1789181254.326582:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789181254.326587:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1789181254.326591:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1789181254.326594:0:6513:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1789181254.326629:0:6513:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000100:00100000:2.0:1789181254.326853:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb7f50eb going to sleep for 11 seconds 00000040:00080000:1.0:1789181254.326876:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181254.327015:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789181254.327050:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789181254.327070:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789181254.327086:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789181254.327099:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789181254.327154:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1789181254.327162:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1789181254.327176:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1789181254.327182:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1789181254.327192:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1789181254.327197:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1789181254.327208:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789181254.327234:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789181254.327346:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1789181254.327355:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:1.0:1789181254.327367:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1789181254.327373:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789181254.327384:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1789181254.327389:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:1.0:1789181254.327400:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1789181254.327405:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789181254.327431:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789181254.327447:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789181254.327456:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789181254.327528:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1789181254.327537:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1789181254.327550:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789181254.327565:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789181254.327580:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1789181254.327585:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1789181254.327614:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789181254.327633:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789181254.327637:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1789181254.327657:0:6513:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789181254.327663:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1789181254.328606:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789181254.328901:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789181254.328926:0:6513:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.101@tcp for mdt 20000000:01000000:2.0:1789181254.328928:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:2.0:1789181254.328976:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789181254.328984:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789181254.328999:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789181254.329005:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:2.0:1789181254.329022:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789181254.329032:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1789181254.329045:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1789181254.329069:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1789181254.329125:0:6513:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1789181254.329134:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1789181254.329536:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1789181254.329782:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789181254.329799:0:6513:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.101@tcp for mdt 20000000:01000000:1.0:1789181254.329801:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:1.0:1789181254.329818:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789181254.329823:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789181254.329837:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789181254.329854:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:1.0:1789181254.329871:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789181254.329878:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1789181254.329892:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789181254.329908:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1789181254.329927:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789181254.329930:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789181254.329935:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789181254.330009:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789181254.330011:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789181254.330365:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1789181254.330385:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1789181254.330402:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789181254.330567:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789181254.330590:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789181254.330613:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789181254.330624:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789181254.330626:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789181254.332018:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789181254.332060:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789181254.332077:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789181254.336343:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789181254.336379:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789181254.336392:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789181254.336402:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789181254.336405:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789181254.337213:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789181254.337242:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789181254.337260:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789181254.337956:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789181254.337984:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789181254.338017:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789181254.338036:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789181254.338039:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789181254.338045:0:6513:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789181254.338052:0:6513:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789181254.339490:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1789181254.340190:0:6513:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789181254.352486:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789181254.352517:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.352538:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005e5a67f2/0x76fb555283516af5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516aee expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.352545:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000caa1322c/0x76fb555283516b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516b0a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.352552:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a52620bc/0x76fb555283516b81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516b7a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.352559:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.352605:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a52620bc/0x76fb555283516b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516b7a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.352621:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a52620bc/0x76fb555283516b81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516b7a expref: 12 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181254.352657:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018eb0a43 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408303872:0@lo:104: 00000100:00100000:2.0:1789181254.353072:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181254.353180:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000caa1322c/0x76fb555283516b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516b0a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.353189:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000caa1322c/0x76fb555283516b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516b0a expref: 12 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181254.353197:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a98a5ba pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408304000:0@lo:104: 00000100:00100000:2.0:1789181254.353223:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181254.353417:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005e5a67f2/0x76fb555283516af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516aee expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.353425:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005e5a67f2/0x76fb555283516af5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516aee expref: 12 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181254.353434:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000baa48452 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408304128:0@lo:104: 00000100:00100000:2.0:1789181254.353458:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.353908:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408303872 00000100:00100000:1.0:1789181254.353909:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408304000 00000100:00100000:1.0:1789181254.353919:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408304000 00000100:00100000:0.0:1789181254.353919:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408303872 00000100:00100000:0.0:1789181254.353973:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181254.353982:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001da9764d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+4:6513:x1876092408303872:12345-0@lo:104: 00010000:00010000:0.0:1789181254.353994:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.354066:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181254.354071:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001da9764d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+4:6513:x1876092408303872:12345-0@lo:104: Request processed in 91us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.354077:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181254.354098:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181254.354104:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000402087af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+3:6513:x1876092408304000:12345-0@lo:104: 00010000:00010000:0.0:1789181254.354111:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.354154:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789181254.354158:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000402087af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+3:6513:x1876092408304000:12345-0@lo:104: Request processed in 56us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.354164:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789181254.354347:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181254.354353:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.354360:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003a1ba348 already unused, calling callback (00000000517fa998) 10000000:00010000:3.0:1789181254.354364:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.354371:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181254.354391:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181254.354396:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181254.354439:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.354446:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181254.354465:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.354471:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 000000003a1ba348/0x76fb555283516b7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.354484:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181254.354487:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.354492:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006521cc3f already unused, calling callback (00000000517fa998) 10000000:00010000:3.0:1789181254.354494:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.354499:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181254.354505:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181254.354510:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181254.354530:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.354537:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181254.354551:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.354556:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 000000006521cc3f/0x76fb555283516b0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b11 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.354565:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181254.354566:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181254.354568:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181254.354576:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181254.354590:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dfc3f2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408304384:0@lo:103: 00000100:00100000:3.0:1789181254.354624:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.354954:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181254.354970:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000532e439e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408304256:0@lo:103: 00000100:00100000:0.0:1789181254.354998:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181254.355031:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181254.355048:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408304384 00000100:00100000:0.0:1789181254.355055:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408304384 00010000:00010000:0.0:1789181254.355077:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000caa1322c/0x76fb555283516b11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516b0a expref: 13 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.355108:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408304256 00000100:00100000:0.0:1789181254.355112:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408304256 00010000:00010000:0.0:1789181254.355122:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a52620bc/0x76fb555283516b81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516b7a expref: 14 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.355139:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181254.355148:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181254.355149:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000046a963a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+14:3644:x1876092408304384:12345-0@lo:103: 00000100:00100000:1.0:1789181254.355162:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001335ad22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+14:3645:x1876092408304256:12345-0@lo:103: 00010000:00010000:0.0:1789181254.355163:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181254.355172:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000caa1322c/0x76fb555283516b11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516b0a expref: 14 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.355176:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181254.355183:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a52620bc/0x76fb555283516b81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516b7a expref: 14 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.355183:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000caa1322c/0x76fb555283516b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516b0a expref: 14 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.355206:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a52620bc/0x76fb555283516b81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516b7a expref: 14 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181254.355443:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408304128 00000100:00100000:3.0:1789181254.355448:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408304128 00000100:00100000:3.0:1789181254.355482:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181254.355489:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f29f7580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:6513:x1876092408304128:12345-0@lo:104: 00010000:00010000:3.0:1789181254.355498:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.355545:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181254.355549:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f29f7580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:6513:x1876092408304128:12345-0@lo:104: Request processed in 62us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181254.355555:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789181254.355573:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181254.355576:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.355593:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f908a90f already unused, calling callback (00000000517fa998) 10000000:00010000:3.0:1789181254.355595:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.355603:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181254.355609:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181254.355614:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181254.355638:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.355645:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181254.355656:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.355662:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516aee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516af5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.355677:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181254.355678:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181254.355679:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181254.355700:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dd1aec0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408304512:0@lo:103: 00000100:00100000:3.0:1789181254.355751:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181254.355802:0:6506:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789181254.355809:0:6506:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789181254.355823:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036597dbc going to sleep for 11 seconds 00000100:00100000:3.0:1789181254.355851:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018eb0a43 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408303872:0@lo:104: 00000100:00100000:3.0:1789181254.355860:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a98a5ba pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408304000:0@lo:104: 00000100:00100000:3.0:1789181254.355866:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000baa48452 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408304128:0@lo:104: 00010000:00010000:0.0:1789181254.356369:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000caa1322c/0x76fb555283516b11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516b0a expref: 14 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.356384:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181254.356423:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000046a963a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+13:3644:x1876092408304384:12345-0@lo:103: Request processed in 1277us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.356430:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181254.356445:0:6505:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789181254.356450:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408304512 00000100:00100000:0.0:1789181254.356460:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408304512 00010000:00010000:0.0:1789181254.356488:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005e5a67f2/0x76fb555283516af5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516aee expref: 13 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.356502:0:6505:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789181254.356508:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181254.356514:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008ff45c9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+13:3644:x1876092408304512:12345-0@lo:103: 00010000:00010000:0.0:1789181254.356522:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181254.356524:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005e5a67f2/0x76fb555283516af5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516aee expref: 13 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.356532:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005e5a67f2/0x76fb555283516af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516aee expref: 13 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.356541:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005e5a67f2/0x76fb555283516af5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516aee expref: 13 pid: 6515 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.356548:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181254.356570:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008ff45c9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+12:3644:x1876092408304512:12345-0@lo:103: Request processed in 57us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.356576:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181254.356705:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dd1aec0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408304512:0@lo:103: 00000100:00100000:0.0:1789181254.356740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dfc3f2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408304384:0@lo:103: 00010000:00010000:1.0:1789181254.362185:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a52620bc/0x76fb555283516b81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516b7a expref: 11 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.362210:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.362219:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.370045:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.370975:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.370990:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.370997:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.371004:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.371010:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bcd12c39 already unused, calling callback (0000000017e9db8a) 00010000:00010000:1.0:1789181254.371013:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.371020:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.371034:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.371061:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181254.371145:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001335ad22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+10:3645:x1876092408304256:12345-0@lo:103: Request processed in 15984us (16142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181254.371156:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181254.371946:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000532e439e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408304256:0@lo:103: 00010000:00010000:2.0:1789181254.375188:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.375209:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.375215:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bcd12c39/0x76fb555283516bc0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789181254.375237:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789181254.381175:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb630a6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+9:7450:x1876092408303744:12345-0@lo:253: Request processed in 54616us (54745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.381201:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098d1a3db pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408303744:0@lo:253: 00000100:00100000:2.0:1789181254.381215:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 10000000:01000000:0.0:1789181254.381222:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789181254.381226:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789181254.381228:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789181254.381249:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789181254.381261:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1789181254.381263:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789181254.381265:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789181254.381266:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789181254.381267:0:7450:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789181254.381269:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789181254.381270:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789181254.381292:0:7450:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000e4ad5cf from lustre-MDT0001 10000000:01000000:0.0:1789181254.381338:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789181254.381341:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789181254.381348:0:7450:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c1dd13ecd40 local copy 10000000:01000000:0.0:1789181254.381351:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789181254.381389:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.381399:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.381408:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.381426:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408304640:0@lo:101: 00000100:00100000:0.0:1789181254.381464:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.381586:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060cf0cd1 going to sleep for 11 seconds 00000100:00100000:3.0:1789181254.382461:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408304640 00000100:00100000:3.0:1789181254.382476:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408304640 00000100:00100000:3.0:1789181254.382602:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789181254.382614:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dddff04d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+9:7450:x1876092408304640:12345-0@lo:101: 00010000:00010000:3.0:1789181254.382629:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181254.382646:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a1ba348/0x76fb555283516bce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516bc7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.382678:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a1ba348/0x76fb555283516bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516bc7 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.382699:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a1ba348/0x76fb555283516bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516bc7 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.382718:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a1ba348, rc 0) 00000100:00100000:3.0:1789181254.382994:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dddff04d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+10:7450:x1876092408304640:12345-0@lo:101: Request processed in 383us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181254.383002:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789181254.383311:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408304640:0@lo:101: 00010000:00010000:0.0:1789181254.383328:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.383338:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.383451:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408304768:0@lo:501: 00000100:00100000:0.0:1789181254.383495:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.383574:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060cf0cd1 going to sleep for 11 seconds 00000100:00100000:2.0:1789181254.383620:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408304768 00000100:00100000:2.0:1789181254.383628:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408304768 00000100:00100000:3.0:1789181254.383676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181254.383686:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042802c41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+10:7450:x1876092408304768:12345-0@lo:501: 00000100:00100000:3.0:1789181254.383952:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042802c41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+10:7450:x1876092408304768:12345-0@lo:501: Request processed in 268us (456us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789181254.383968:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181254.384041:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408304768:0@lo:501: 10000000:01000000:0.0:1789181254.384056:0:7450:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789181254.384074:0:7450:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789181254.384079:0:7450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.384104:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.384119:0:7450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.384135:0:7450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789181254.384161:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c1df1a64800 10000000:01000000:0.0:1789181254.384165:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789181254.384171:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c1dd13ecd40 10000000:01000000:0.0:1789181254.384174:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789181254.384177:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c1dd13ecd40 from 1 10000000:01000000:0.0:1789181254.384180:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789181254.384203:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000caa1322c/0x76fb555283516bd5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.384211:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000caa1322c/0x76fb555283516bd5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.384218:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000caa1322c/0x76fb555283516bd5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.384239:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408304896:0@lo:101: 00000100:00100000:0.0:1789181254.384273:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.384298:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025b23906 going to sleep for 11 seconds 00000100:00100000:3.0:1789181254.384455:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408304896 00000100:00100000:3.0:1789181254.384461:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408304896 00000100:00100000:3.0:1789181254.384506:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789181254.384513:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3b175f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+10:7450:x1876092408304896:12345-0@lo:101: 00010000:00010000:3.0:1789181254.384521:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181254.384533:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fead5e17/0x76fb555283516bdc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516bd5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.384549:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fead5e17/0x76fb555283516bdc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516bd5 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.384556:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fead5e17/0x76fb555283516bdc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516bd5 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.384563:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fead5e17, rc 0) 00000100:00100000:3.0:1789181254.384590:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3b175f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+11:7450:x1876092408304896:12345-0@lo:101: Request processed in 78us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181254.384596:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181254.384669:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408304896:0@lo:101: 00010000:00010000:0.0:1789181254.384682:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000caa1322c/0x76fb555283516bd5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bdc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.384699:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000caa1322c/0x76fb555283516bd5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516bdc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181254.384924:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789181254.384978:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000caa1322c/0x76fb555283516bd5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bdc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.384986:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000caa1322c/0x76fb555283516bd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bdc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181254.384995:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c1df1a64800 10000000:01000000:0.0:1789181254.385000:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789181254.385004:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c1df1a64800 from 1 10000000:01000000:0.0:1789181254.385018:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789181254.385037:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000461b9b69/0x76fb555283516be3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.385043:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000461b9b69/0x76fb555283516be3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.385050:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000461b9b69/0x76fb555283516be3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.385069:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305024:0@lo:101: 00000100:00100000:0.0:1789181254.385098:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.385134:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025b23906 going to sleep for 11 seconds 00000100:00100000:0.0:1789181254.385151:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408305024 00000100:00100000:0.0:1789181254.385155:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408305024 00000100:00100000:0.0:1789181254.385178:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789181254.385184:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000027e7e03a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+11:7450:x1876092408305024:12345-0@lo:101: 00010000:00010000:0.0:1789181254.385191:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181254.385198:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f6e7309/0x76fb555283516bea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516be3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.385211:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f6e7309/0x76fb555283516bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516be3 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.385218:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f6e7309/0x76fb555283516bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516be3 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.385224:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f6e7309, rc 0) 00000100:00100000:0.0:1789181254.385267:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000027e7e03a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:7450:x1876092408305024:12345-0@lo:101: Request processed in 83us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.385273:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789181254.385297:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305024:0@lo:101: 00010000:00010000:0.0:1789181254.385306:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000461b9b69/0x76fb555283516be3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.385312:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000461b9b69/0x76fb555283516be3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181254.385336:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789181254.385402:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181254.385408:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.385416:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005e5a67f2 already unused, calling callback (00000000517fa998) 10000000:00010000:1.0:1789181254.385419:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.385427:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181254.385433:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181254.385439:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789181254.385460:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.385467:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181254.385486:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.385492:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 000000005e5a67f2/0x76fb555283516bc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x76fb555283516bce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.385517:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181254.385518:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181254.385520:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181254.385531:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408305152:0@lo:103: 00000100:00100000:1.0:1789181254.385564:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.385598:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408305152 00000100:00100000:1.0:1789181254.385602:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408305152 00000100:00100000:1.0:1789181254.385632:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181254.385638:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8880032 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+12:3645:x1876092408305152:12345-0@lo:103: 00010000:00010000:1.0:1789181254.385648:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181254.385659:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003a1ba348/0x76fb555283516bce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283516bc7 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.385670:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181254.385720:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8880032 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+11:3645:x1876092408305152:12345-0@lo:103: Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181254.385741:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181254.385769:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408305152:0@lo:103: 00010000:00010000:0.0:1789181254.387034:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000461b9b69/0x76fb555283516be3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.387049:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000461b9b69/0x76fb555283516be3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181254.387057:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789181254.387062:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789181254.387069:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c1df1a64800 10000000:01000000:0.0:1789181254.387072:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789181254.387075:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789181254.387077:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789181254.387105:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000004ba551a4/0x76fb555283516bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.387122:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000004ba551a4/0x76fb555283516bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.387131:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000004ba551a4/0x76fb555283516bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.387149:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305280:0@lo:101: 00000100:00100000:0.0:1789181254.387192:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.387219:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025b23906 going to sleep for 11 seconds 00000100:00100000:2.0:1789181254.387423:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408305280 00000100:00100000:2.0:1789181254.387430:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408305280 00000100:00100000:2.0:1789181254.387479:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789181254.387487:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e573dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+11:7450:x1876092408305280:12345-0@lo:101: 00010000:00010000:2.0:1789181254.387498:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181254.387511:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bcd12c39/0x76fb555283516bf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516bf1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.387532:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bcd12c39/0x76fb555283516bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516bf1 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.387541:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bcd12c39/0x76fb555283516bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516bf1 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.387547:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bcd12c39, rc 0) 00000100:00100000:2.0:1789181254.387598:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e573dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+12:7450:x1876092408305280:12345-0@lo:101: Request processed in 112us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.387605:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789181254.387699:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305280:0@lo:101: 00010000:00010000:1.0:1789181254.387720:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000004ba551a4/0x76fb555283516bf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.387758:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000004ba551a4/0x76fb555283516bf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181254.387866:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305408:0@lo:501: 00000100:00100000:1.0:1789181254.387905:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.387924:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028136de5 going to sleep for 11 seconds 00000100:00100000:2.0:1789181254.388088:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408305408 00000100:00100000:2.0:1789181254.388093:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408305408 00000100:00100000:2.0:1789181254.388135:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789181254.388142:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a0c7c684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:7450:x1876092408305408:12345-0@lo:501: 00000100:00100000:2.0:1789181254.388247:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a0c7c684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:7450:x1876092408305408:12345-0@lo:501: Request processed in 106us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.388268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789181254.388471:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305408:0@lo:501: 00000100:00100000:1.0:1789181254.388504:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305536:0@lo:503: 00000100:00100000:1.0:1789181254.388544:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.388566:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028136de5 going to sleep for 11 seconds 00000100:00100000:0.0:1789181254.388621:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408305536 00000100:00100000:0.0:1789181254.388625:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408305536 00000100:00100000:0.0:1789181254.388658:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789181254.388665:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000000a71280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+12:7450:x1876092408305536:12345-0@lo:503: 00000100:00100000:1.0:1789181254.388976:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305536:0@lo:503: 00000040:00080000:1.0:1789181254.389398:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789181254.389494:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305664:0@lo:502: 00000100:00100000:1.0:1789181254.389534:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.389561:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028136de5 going to sleep for 11 seconds 00000100:00100000:1.0:1789181254.389578:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408305664 00000100:00100000:1.0:1789181254.389583:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408305664 00000100:00100000:1.0:1789181254.389605:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789181254.389610:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a320a973 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+13:7450:x1876092408305664:12345-0@lo:502: 00000100:00100000:1.0:1789181254.389687:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a320a973 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+13:7450:x1876092408305664:12345-0@lo:502: Request processed in 76us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181254.389704:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789181254.389918:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305664:0@lo:502: 00000100:00100000:0.0:1789181254.390187:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000000a71280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+12:7450:x1876092408305536:12345-0@lo:503: Request processed in 128us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.390197:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000040:00080000:1.0:1789181254.390476:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789181254.390506:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1789181254.390521:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1789181254.390536:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1789181254.390548:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1789181254.390560:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1789181254.390573:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1789181254.390585:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1789181254.390647:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1789181254.390664:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1789181254.390676:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1789181254.390891:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1789181254.390911:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1789181254.390925:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1789181254.390937:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1789181254.390948:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1789181254.390960:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1789181254.390972:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1789181254.390985:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1789181254.390998:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1789181254.391011:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1789181254.391025:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1789181254.391039:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1789181254.391070:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305792:0@lo:502: 00000100:00100000:1.0:1789181254.391382:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.391466:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028136de5 going to sleep for 11 seconds 00000100:00100000:2.0:1789181254.394938:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408305792 00000100:00100000:2.0:1789181254.394956:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408305792 00000100:00100000:2.0:1789181254.395090:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789181254.395101:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e59e67e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+12:7450:x1876092408305792:12345-0@lo:502: 00000100:00100000:2.0:1789181254.396244:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e59e67e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+12:7450:x1876092408305792:12345-0@lo:502: Request processed in 1140us (4857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.396399:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181254.396537:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408305792:0@lo:502: 00000040:00080000:1.0:1789181254.396641:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1789181254.396655:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1789181254.399143:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181254.399158:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181254.399161:0:7463:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789181254.399168:0:7463:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789181254.399171:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789181254.399187:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000adeac493) 00000020:00000080:1.0:1789181254.399210:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1789181254.399216:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789181254.399544:0:7463:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789181254.399553:0:7463:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb555283516c06 00000020:00000080:1.0:1789181254.400047:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789181254.400053:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181254.400058:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181254.400060:0:7463:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789181254.400064:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181254.400069:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181254.400070:0:7463:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789181254.400074:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789181254.400081:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000009312b2d5) 00000020:00000080:1.0:1789181254.400093:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1789181254.400097:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789181254.400099:0:7463:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789181254.400101:0:7463:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789181254.400169:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789181254.400237:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000e4ad5cf from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789181254.400319:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000291b6360) 00000020:00000080:1.0:1789181254.400332:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1789181254.400396:0:7463:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789181254.400402:0:7463:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb555283516c1b 00000020:00000080:1.0:1789181254.400495:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789181254.400502:0:7463:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789181254.400506:0:7463:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x76fb555283516c22 00080000:01000000:1.0:1789181254.400512:0:7463:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789181254.400515:0:7463:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb555283516c29 00080000:10000000:1.0:1789181254.405081:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1789181254.405881:0:7463:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1789181254.647070:0:7463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789181254.647516:0:7463:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789181254.656226:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789181254.656623:0:7463:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789181254.695020:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789181254.695049:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181254.695066:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181254.695069:0:7463:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789181254.695074:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181254.695079:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181254.695080:0:7463:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789181254.695084:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789181254.695089:0:7463:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:00000080:0.0:1789181254.695120:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181254.695137:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000f532f9e2) 00000020:00000080:0.0:1789181254.695161:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789181254.695167:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789181254.695269:0:7463:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789181254.695276:0:7463:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789181254.695283:0:7463:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb555283516c37 00010000:00080000:0.0:1789181254.695315:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f66cce47@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1789181254.706178:0:7463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1789181254.719603:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789181254.719620:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789181254.719672:0:7463:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789181254.719749:0:7463:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb555283516c3e 00000100:00080000:0.0:1789181254.719760:0:7463:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789181254.719771:0:7463:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000f66cce47 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181254.720311:0:7463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fa45e905 x1876092408305920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181254.720356:0:7463:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789181254.720496:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032041dce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408306048:0@lo:400: 00000100:00100000:0.0:1789181254.720564:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.720644:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408306048 00000100:00100000:3.0:1789181254.720855:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa45e905 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408305920:0@lo:38: 00000100:00100000:3.0:1789181254.720894:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181254.720968:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408305920 00000100:00100000:3.0:1789181254.720977:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408305920 00000100:00100000:3.0:1789181254.721014:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181254.721040:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c54a4420 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876092408305920:12345-0@lo:38: 00000100:00100000:0.0:1789181254.721391:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408306048 00000100:00100000:0.0:1789181254.721431:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181254.721437:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000289db265 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408306048:12345-0@lo:400: 00010000:00080000:3.0:1789181254.721527:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1789181254.721573:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb555283516c45 00000004:00100000:3.0:1789181254.721592:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789181254.721598:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789181254.723367:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000289db265 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408306048:12345-0@lo:400: Request processed in 1924us (2797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.723382:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1789181254.723495:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181254.723501:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181254.723503:0:7463:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789181254.723506:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789181254.723509:0:7463:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789181254.723511:0:7463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789181254.723513:0:7463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789181254.723514:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789181254.723517:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181254.723518:0:7463:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789181254.723520:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181254.723525:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181254.723526:0:7463:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789181254.723530:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789181254.723580:0:7463:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789181254.723594:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181254.723598:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181254.723599:0:7463:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789181254.723602:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181254.723620:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181254.723621:0:7463:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789181254.723624:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789181254.723626:0:7463:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789181254.723668:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181254.723672:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181254.723673:0:7463:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789181254.723676:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00010000:00080000:3.0:1789181254.727618:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000032041dce x1876092408306048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181254.727642:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032041dce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408306048:0@lo:400: 00000020:01000000:1.0:1789181254.728435:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1789181254.728483:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789181254.728504:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000004ba551a4/0x76fb555283516bf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.728517:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000004ba551a4/0x76fb555283516bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181254.728541:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1df1a64800 from 1 10000000:01000000:1.0:1789181254.728545:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789181254.728582:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.728590:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.728600:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181254.728625:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306176:0@lo:101: 00000100:00100000:1.0:1789181254.728751:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.728815:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5fed193 going to sleep for 11 seconds 00000100:00100000:3.0:1789181254.729773:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408306176 00000100:00100000:3.0:1789181254.729788:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408306176 00000100:00100000:3.0:1789181254.730042:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789181254.730052:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b73917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+12:7450:x1876092408306176:12345-0@lo:101: 00010000:00010000:3.0:1789181254.730268:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181254.730283:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068deab27/0x76fb555283516c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516c4c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.730327:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068deab27/0x76fb555283516c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516c4c expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.730339:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068deab27/0x76fb555283516c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516c4c expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.730346:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068deab27, rc 0) 00000100:00100000:3.0:1789181254.730413:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b73917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+13:7450:x1876092408306176:12345-0@lo:101: Request processed in 362us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181254.730420:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789181254.730492:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306176:0@lo:101: 00010000:00010000:3.0:1789181254.730509:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.730518:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181254.733664:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306304:0@lo:256: 00000100:00100000:3.0:1789181254.736287:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181254.736376:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ea78bce going to sleep for 11 seconds 00000100:00100000:2.0:1789181254.738418:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408306304 00000100:00100000:2.0:1789181254.738437:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408306304 00000100:00100000:2.0:1789181254.740429:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789181254.740441:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc2abf02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+13:7450:x1876092408306304:12345-0@lo:256: 20000000:01000000:2.0:1789181254.741555:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789181254.741582:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789181254.741585:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789181254.743571:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306304:0@lo:256: 00000100:00100000:2.0:1789181254.744002:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc2abf02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+13:7450:x1876092408306304:12345-0@lo:256: Request processed in 3561us (7720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.744016:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 10000000:01000000:3.0:1789181254.746429:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789181254.746913:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.746928:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181254.746937:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1df1a64800 from 1 10000000:01000000:3.0:1789181254.746940:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181254.746985:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.746992:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.747002:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181254.747717:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306432:0@lo:101: 00000100:00100000:3.0:1789181254.750772:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.750884:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408306432 00000100:00100000:1.0:1789181254.750896:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408306432 00000100:00100000:1.0:1789181254.750955:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789181254.750964:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f963ac87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+13:7450:x1876092408306432:12345-0@lo:101: 00010000:00010000:1.0:1789181254.750984:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181254.751004:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bdba800c/0x76fb555283516c61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516c5a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.751036:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bdba800c/0x76fb555283516c61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516c5a expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.751048:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bdba800c/0x76fb555283516c61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516c5a expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.751056:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bdba800c, rc 0) 00000100:00100000:1.0:1789181254.753562:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f963ac87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+14:7450:x1876092408306432:12345-0@lo:101: Request processed in 2581us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181254.753575:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789181254.762151:0:6526:0:(import.c:65:import_set_state_nolock()) 0000000060b9531b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181254.762269:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c54a4420 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876092408305920:12345-0@lo:38: Request processed in 41243us (41372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181254.762285:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181254.762501:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181254.762511:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789181254.762518:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789181254.763738:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789181254.763750:0:3642:0:(import.c:65:import_set_state_nolock()) 00000000f66cce47 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789181254.763773:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa45e905 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408305920:0@lo:38: 00000100:00100000:3.0:1789181254.771080:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ea78bce going to sleep for 11 seconds 00000100:00100000:3.0:1789181254.771144:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306432:0@lo:101: 00010000:00010000:3.0:1789181254.771177:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.771190:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181254.771333:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306560:0@lo:501: 00000100:00100000:3.0:1789181254.771399:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181254.771441:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ea78bce going to sleep for 11 seconds 00000100:00100000:2.0:1789181254.771523:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408306560 00000100:00100000:2.0:1789181254.771531:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408306560 00000100:00100000:2.0:1789181254.771590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789181254.771599:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000687ccce4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:7450:x1876092408306560:12345-0@lo:501: 00000100:00100000:2.0:1789181254.771721:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000687ccce4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:7450:x1876092408306560:12345-0@lo:501: Request processed in 122us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.771766:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789181254.771984:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306560:0@lo:501: 00000100:00100000:3.0:1789181254.772014:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306688:0@lo:503: 00000100:00100000:3.0:1789181254.772052:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181254.772080:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ea78bce going to sleep for 11 seconds 00000100:00100000:2.0:1789181254.772136:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408306688 00000100:00100000:2.0:1789181254.772140:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408306688 00000100:00100000:2.0:1789181254.772174:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789181254.772179:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000039ffbe6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+14:7450:x1876092408306688:12345-0@lo:503: 00000040:00080000:2.0:1789181254.772212:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789181254.772253:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000039ffbe6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+14:7450:x1876092408306688:12345-0@lo:503: Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.772259:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789181254.773005:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b6a43ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408306816:0@lo:41: 00000100:00100000:0.0:1789181254.773075:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181254.773192:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408306816 00000100:00100000:2.0:1789181254.773198:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408306816 00000100:00100000:2.0:1789181254.773242:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181254.773250:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000be6f926 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1876092408306816:12345-0@lo:41: 00000004:00000024:2.0:1789181254.773277:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789181254.773336:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000be6f926 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1876092408306816:12345-0@lo:41: Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.773343:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181254.773474:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306688:0@lo:503: 00000040:00080000:3.0:1789181254.773857:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181254.773914:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789181254.773997:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789181254.775108:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b6a43ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408306816:0@lo:41: 00000040:00080000:3.0:1789181254.776167:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1789181254.782208:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789181254.782260:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181254.782274:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.782288:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181254.782945:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789181254.782950:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c1df1a64800 10000000:01000000:0.0:1789181254.782953:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c1df1a64800 10000000:01000000:0.0:1789181254.782959:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789181254.782965:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1df1a64800 from 1 10000000:01000000:0.0:1789181254.782968:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181254.783003:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d6455a37/0x76fb555283516c68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.783013:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000d6455a37/0x76fb555283516c68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.783041:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000d6455a37/0x76fb555283516c68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.783202:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bcd4172d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306944:0@lo:101: 00000100:00100000:0.0:1789181254.783282:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181254.783861:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408306944 00000100:00100000:3.0:1789181254.783872:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408306944 00000100:00100000:3.0:1789181254.783981:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181254.783990:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d98067b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+14:7450:x1876092408306944:12345-0@lo:101: 00010000:00010000:3.0:1789181254.784019:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181254.784035:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a1ba348/0x76fb555283516c6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516c68 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.784071:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a1ba348/0x76fb555283516c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516c68 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.784081:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a1ba348/0x76fb555283516c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516c68 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181254.784090:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a1ba348, rc 0) 00000100:00100000:3.0:1789181254.784138:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d98067b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408306944:12345-0@lo:101: Request processed in 149us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181254.784145:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789181254.784969:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000003bb9f110 going to sleep for 11 seconds 00000100:00100000:1.0:1789181254.785002:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bcd4172d pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408306944:0@lo:101: 00010000:00010000:1.0:1789181254.785023:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000d6455a37/0x76fb555283516c68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181254.785033:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000d6455a37/0x76fb555283516c68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181254.785176:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000045dc6660 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408307072:0@lo:501: 00000100:00100000:1.0:1789181254.785221:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.795096:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5fed193 going to sleep for 11 seconds 00000100:00100000:2.0:1789181254.798588:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408307072 00000100:00100000:2.0:1789181254.798608:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408307072 00000100:00100000:2.0:1789181254.798680:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789181254.798701:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000092bda36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408307072:12345-0@lo:501: 00000100:00100000:2.0:1789181254.802817:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000092bda36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408307072:12345-0@lo:501: Request processed in 4042us (17520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.802833:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789181254.802993:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000045dc6660 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408307072:0@lo:501: 00000100:00100000:1.0:1789181254.803049:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000045dc6660 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408307200:0@lo:503: 00000100:00100000:1.0:1789181254.803246:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.803292:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5fed193 going to sleep for 11 seconds 00000100:00100000:2.0:1789181254.803971:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408307200 00000100:00100000:2.0:1789181254.803981:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408307200 00000100:00100000:2.0:1789181254.804022:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789181254.804029:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009fb5af31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408307200:12345-0@lo:503: 00000100:00100000:2.0:1789181254.806284:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009fb5af31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408307200:12345-0@lo:503: Request processed in 2247us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.806324:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789181254.807606:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000045dc6660 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408307200:0@lo:503: 00000040:00080000:1.0:1789181254.808007:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789181254.808126:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000045dc6660 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408307328:0@lo:502: 00000100:00100000:1.0:1789181254.808190:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.808233:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000003a48df88 going to sleep for 11 seconds 00000100:00100000:3.0:1789181254.808582:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408307328 00000100:00100000:3.0:1789181254.808590:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408307328 00000100:00100000:3.0:1789181254.808632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789181254.808641:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e047858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408307328:12345-0@lo:502: 00000100:00100000:3.0:1789181254.808796:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e047858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408307328:12345-0@lo:502: Request processed in 156us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181254.808804:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789181254.810841:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000045dc6660 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408307328:0@lo:502: 00000040:00080000:1.0:1789181254.811133:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789181254.811164:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789181254.811178:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789181254.811190:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789181254.811203:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789181254.811215:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789181254.811227:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789181254.811241:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789181254.811253:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789181254.811267:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789181254.811298:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789181254.811328:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789181254.811347:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789181254.811360:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789181254.811372:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789181254.811384:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789181254.811395:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789181254.811406:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789181254.811416:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789181254.811428:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789181254.811440:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789181254.812564:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789181254.812589:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789181254.812604:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789181254.812618:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789181254.812631:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789181254.812663:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789181254.812678:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789181254.814275:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000045dc6660 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408307456:0@lo:502: 00000100:00100000:1.0:1789181254.816263:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181254.816426:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408307456 00000100:00100000:3.0:1789181254.816435:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408307456 00000100:00100000:3.0:1789181254.816495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789181254.816503:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000abb7b380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408307456:12345-0@lo:502: 00000100:00100000:3.0:1789181254.816621:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000abb7b380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408307456:12345-0@lo:502: Request processed in 119us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181254.816629:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789181254.817039:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000003a48df88 going to sleep for 11 seconds 00000100:00100000:1.0:1789181254.817137:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000045dc6660 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408307456:0@lo:502: 00000040:00080000:1.0:1789181254.817216:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789181254.817229:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789181254.818984:0:7469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789181254.819011:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000011e6a6e) 00000020:00000080:0.0:1789181254.819036:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789181254.819596:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000e4ad5cf from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789181254.819601:0:7469:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000e4ad5cf from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789181254.819604:0:7469:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000e4ad5cf 3 00010000:00080000:0.0:1789181254.819643:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000060dae6de@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1789181254.822902:0:7469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1789181254.823115:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789181254.823161:0:7469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789181254.823175:0:7469:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x76fb555283516c7d 00000100:00080000:0.0:1789181254.823185:0:7469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789181254.823195:0:7469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000060dae6de using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181254.823242:0:7469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000181368de x1876092408307584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181254.823269:0:7469:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789181254.823602:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000181368de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876092408307584:0@lo:38: 00000100:00100000:1.0:1789181254.823674:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181254.823993:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408307584 00000100:00100000:3.0:1789181254.824003:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408307584 00000100:00100000:3.0:1789181254.824035:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181254.824042:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000045dc6660 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876092408307584:12345-0@lo:38: 00010000:00080000:3.0:1789181254.824078:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1789181254.824110:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x76fb555283516c84 00000004:00100000:3.0:1789181254.824124:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789181254.824152:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000cdd6e97b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181254.824212:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000045dc6660 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876092408307584:12345-0@lo:38: Request processed in 170us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181254.824220:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789181254.824555:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000181368de x1876092408307584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181254.824566:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789181254.824573:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789181254.824579:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789181254.824583:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789181254.824585:0:3642:0:(import.c:65:import_set_state_nolock()) 0000000060dae6de lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789181254.824591:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000181368de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876092408307584:0@lo:38: 00000040:00080000:0.0:1789181254.831129:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789181254.832648:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789181254.832697:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181254.832743:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d6455a37/0x76fb555283516c68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181254.832758:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000d6455a37/0x76fb555283516c68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789181254.832815:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789181254.832817:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789181254.832818:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181254.832819:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181254.832821:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181254.832822:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181254.832823:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181254.832825:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181254.832826:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181254.832828:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181254.832829:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181254.832833:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1789181254.832835:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181254.832837:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789181254.832838:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181254.832839:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181254.832840:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181254.832841:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181254.832842:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181254.832842:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181254.832843:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181254.832845:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181254.832845:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181254.832872:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789181254.832890:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f69e4c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408307712:0@lo:253: 00000100:00100000:2.0:1789181254.832961:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181254.833012:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000009595d34d going to sleep for 11 seconds 00000100:00100000:0.0:1789181254.833147:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408307712 00000100:00100000:0.0:1789181254.833155:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408307712 00000100:00100000:0.0:1789181254.833200:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789181254.833210:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083ac5cf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408307712:12345-0@lo:253: 20000000:01000000:0.0:1789181254.833238:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789181254.833258:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789181254.838854:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789181254.838891:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789181254.838904:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789181254.838950:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789181254.838955:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789181254.838977:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839002:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a38ebea9/0x76fb555283516bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ba4 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839010:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000068deab27/0x76fb555283516c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516c4c expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839017:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839074:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000068deab27/0x76fb555283516c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516c4c expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839090:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000068deab27/0x76fb555283516c53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516c4c expref: 15 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.839106:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408307840:0@lo:104: 00000100:00100000:0.0:1789181254.839174:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181254.839219:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a38ebea9/0x76fb555283516bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516ba4 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839226:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a38ebea9/0x76fb555283516bab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516ba4 expref: 15 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.839256:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f53b9c78 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408307968:0@lo:104: 00000100:00100000:0.0:1789181254.839274:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.839289:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 0000000056a68e64 going to sleep for 11 seconds 00000100:00100000:0.0:1789181254.839602:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408307840 00000100:00100000:0.0:1789181254.839611:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408307840 00000100:00100000:0.0:1789181254.839642:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408307968 00000100:00100000:0.0:1789181254.839644:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408307968 00000100:00100000:0.0:1789181254.839655:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181254.839662:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b26b9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:6537:x1876092408307840:12345-0@lo:104: 00010000:00010000:0.0:1789181254.839674:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839754:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181254.839759:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b26b9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:6537:x1876092408307840:12345-0@lo:104: Request processed in 98us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.839765:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181254.839781:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181254.839786:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007bc52d22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:6537:x1876092408307968:12345-0@lo:104: 00010000:00010000:0.0:1789181254.839792:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839818:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789181254.839822:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007bc52d22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:6537:x1876092408307968:12345-0@lo:104: Request processed in 37us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.839826:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181254.839869:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083ac5cf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:7450:x1876092408307712:12345-0@lo:253: Request processed in 6662us (6910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.839885:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789181254.839924:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408307840:0@lo:104: 00000100:00100000:0.0:1789181254.839931:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f53b9c78 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408307968:0@lo:104: 00010000:00010000:0.0:1789181254.839948:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839961:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789181254.839965:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839972:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a52620bc already unused, calling callback (00000000517fa998) 10000000:00010000:0.0:1789181254.839976:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.839983:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181254.839989:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181254.839995:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181254.840018:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.840024:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181254.840039:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.840045:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000a52620bc/0x76fb555283516c4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c53 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.841537:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181254.841542:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.841551:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a36b1b68 already unused, calling callback (00000000517fa998) 10000000:00010000:0.0:1789181254.841554:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.841561:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181254.841567:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181254.841572:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181254.841607:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.841613:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181254.841634:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.841640:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000a36b1b68/0x76fb555283516ba4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516bab expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.841652:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181254.841653:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181254.841655:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181254.841665:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181254.841699:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f53b9c78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408308096:0@lo:103: 00000100:00100000:0.0:1789181254.841771:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.841895:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408308224:0@lo:103: 00000100:00100000:0.0:1789181254.841922:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.841965:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408308096 00000100:00100000:0.0:1789181254.841973:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408308096 00010000:00010000:0.0:1789181254.841996:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000068deab27/0x76fb555283516c53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516c4c expref: 15 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.842018:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408308224 00000100:00100000:0.0:1789181254.842020:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408308224 00010000:00010000:0.0:1789181254.842030:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a38ebea9/0x76fb555283516bab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516ba4 expref: 16 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.842046:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181254.842054:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000086902b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+16:3644:x1876092408308096:12345-0@lo:103: 00000100:00100000:2.0:1789181254.842206:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f69e4c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:7450:1876092408307712:0@lo:253: 10000000:01000000:2.0:1789181254.842221:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789181254.842224:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789181254.842227:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789181254.842228:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181254.842229:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181254.842231:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181254.842232:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181254.842233:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181254.842235:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181254.842236:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181254.842238:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181254.842239:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789181254.842253:0:7450:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789181254.846050:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181254.846117:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000068deab27/0x76fb555283516c53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516c4c expref: 16 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.846137:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000068deab27/0x76fb555283516c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516c4c expref: 16 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.846155:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068deab27/0x76fb555283516c53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516c4c expref: 16 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.846171:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181254.846252:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000086902b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+15:3644:x1876092408308096:12345-0@lo:103: Request processed in 4198us (4480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.846260:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181254.846311:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181254.848169:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000046c8f723 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+14:3645:x1876092408308224:12345-0@lo:103: 00010000:00010000:0.0:1789181254.848193:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181254.848202:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a38ebea9/0x76fb555283516bab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516ba4 expref: 14 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848217:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a38ebea9/0x76fb555283516bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516ba4 expref: 14 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848233:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a38ebea9/0x76fb555283516bab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516ba4 expref: 14 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848246:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848254:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789181254.848276:0:7462:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012487745s 00010000:00010000:0.0:1789181254.848280:0:7462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848286:0:7462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848291:0:7462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848298:0:7462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848304:0:7462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000051ad2657 already unused, calling callback (0000000017e9db8a) 00010000:00010000:0.0:1789181254.848608:0:7462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848617:0:7462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848636:0:7462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848647:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181254.848743:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000046c8f723 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+13:3645:x1876092408308224:12345-0@lo:103: Request processed in 584us (6819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181254.848752:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181254.848843:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f53b9c78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408308096:0@lo:103: 00010000:00010000:0.0:1789181254.848872:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848880:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181254.848885:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000051ad2657/0x76fb555283516c8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181254.848912:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408308224:0@lo:103: 40000000:00080000:1.0:1789181254.849231:0:7470:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00080000:10000000:2.0:1789181254.851669:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1789181254.851917:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789181254.852609:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789181254.852924:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789181254.855007:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789181254.856294:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789181254.857386:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789181254.857847:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789181254.858049:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789181254.858278:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789181254.858774:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789181254.858961:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1789181254.860897:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789181254.861225:0:7474:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789181254.861229:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789181254.861572:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789181254.861633:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876092408308352:0@lo:700: 00000100:00100000:3.0:1789181254.861764:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181254.861800:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c21b1b5b going to sleep for 11 seconds 00000100:00100000:0.0:1789181254.862016:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408308352 00000100:00100000:0.0:1789181254.862025:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408308352 00000100:00100000:0.0:1789181254.862087:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181254.862096:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3d8aa73 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1876092408308352:12345-0@lo:700: 00000040:01000000:2.0:1789181254.862308:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789181254.862850:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f69e4c6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876092408308480:0@lo:1000: 00000100:00100000:2.0:1789181254.862909:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181254.862943:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408308480 00000100:00100000:2.0:1789181254.862948:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408308480 00000100:00100000:2.0:1789181254.862987:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181254.862993:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000709d282f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876092408308480:12345-0@lo:1000: 00000040:01000000:3.0:1789181254.863533:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789181254.863654:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789181254.864150:0:7450:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789181254.864159:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789181254.864300:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181254.865343:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789181254.865956:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789181254.865990:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789181254.866167:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789181254.866376:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1789181254.867263:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000709d282f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876092408308480:12345-0@lo:1000: Request processed in 4263us (4348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.867279:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181254.867363:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000001abc5b2a going to sleep for 11 seconds 00000100:00100000:2.0:1789181254.867396:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f69e4c6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876092408308480:0@lo:1000: 00000040:01000000:2.0:1789181254.867437:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789181254.867654:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f69e4c6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876092408308608:0@lo:700: 00000100:00100000:2.0:1789181254.867752:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181254.867786:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b67ba080 going to sleep for 11 seconds 00000100:00100000:1.0:1789181254.867927:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408308608 00000100:00100000:1.0:1789181254.867936:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408308608 00000100:00100000:1.0:1789181254.867987:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181254.867995:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001af70600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876092408308608:12345-0@lo:700: 00000100:00100000:1.0:1789181254.868174:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001af70600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876092408308608:12345-0@lo:700: Request processed in 179us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181254.868181:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181254.868211:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f69e4c6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876092408308608:0@lo:700: 00000100:00100000:1.0:1789181254.868260:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ea41ec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1876092408308736:0@lo:900: 00000100:00100000:1.0:1789181254.868298:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181254.868411:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408308736 00000100:00100000:2.0:1789181254.868416:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408308736 00000100:00100000:2.0:1789181254.868458:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181254.868465:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000041a012bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1876092408308736:12345-0@lo:900: 00000100:00100000:1.0:1789181254.868563:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000003a48df88 going to sleep for 11 seconds 00100000:10000000:3.0:1789181254.869555:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789181254.871274:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789181254.871713:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789181254.871921:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789181254.872147:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789181254.872282:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000100:00100000:2.0:1789181254.872644:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000041a012bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1876092408308736:12345-0@lo:900: Request processed in 4175us (4341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181254.872659:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1789181254.872961:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789181254.873223:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789181254.873602:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789181254.873780:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789181254.873918:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789181254.874049:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789181254.874635:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789181254.874818:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789181254.874962:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00010000:00080000:1.0:1789181254.875266:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a8ea41ec x1876092408308736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789181270 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181254.875282:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ea41ec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1876092408308736:0@lo:900: 00000100:00100000:1.0:1789181254.875616:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ea41ec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876092408308864:0@lo:1000: 00000100:00100000:1.0:1789181254.875681:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.875852:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408308864 00000100:00100000:1.0:1789181254.875860:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408308864 00000100:00100000:1.0:1789181254.875906:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789181254.875914:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005579a552 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876092408308864:12345-0@lo:1000: 00000100:00100000:1.0:1789181254.875985:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005579a552 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876092408308864:12345-0@lo:1000: Request processed in 72us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181254.875992:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789181254.876023:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6c0a08b going to sleep for 11 seconds 00000100:00100000:1.0:1789181254.876039:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ea41ec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876092408308864:0@lo:1000: 40000000:02000000:3.0:1789181254.876969:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000004:00080000:1.0:1789181254.877766:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003a48df88 with version 0 00000020:00100000:1.0:1789181254.877798:0:7476:0:(genops.c:2429:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789181254.877808:0:7476:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a8ea41ec x1876092408309120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181254.877832:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ea41ec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876092408309120:0@lo:1000: 00000100:00100000:1.0:1789181254.877895:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181254.877935:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408309120 00000100:00100000:1.0:1789181254.877941:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408309120 00000100:00100000:1.0:1789181254.877979:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181254.877985:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002b3184a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876092408309120:12345-0@lo:1000: 00100000:10000000:2.0:1789181254.879407:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:1.0:1789181254.879918:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a9cbf67 going to sleep for 11 seconds 00100000:10000000:2.0:1789181254.881289:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789181254.882434:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789181254.882632:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789181254.882823:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789181254.882952:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789181254.884209:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789181254.885308:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789181254.885637:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789181254.885797:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789181254.885930:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789181254.887187:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789181254.888286:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000001:00080000:0.0:1789181254.889763:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1789181254.889935:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002b3184a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1876092408309120:12345-0@lo:1000: Request processed in 11946us (12037us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789181254.889947:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1789181254.890032:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789181254.890037:0:7476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789181254.890052:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ea41ec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876092408309120:0@lo:1000: 00000100:00100000:0.0:1789181254.890200:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876092408309248:0@lo:1000: 00000100:00100000:0.0:1789181254.890236:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181254.890275:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e6e7a4c going to sleep for 11 seconds 00000100:00100000:1.0:1789181254.890396:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408309248 00000100:00100000:1.0:1789181254.890403:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408309248 00000100:00100000:1.0:1789181254.890496:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789181254.890506:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f53b9c78 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876092408309248:12345-0@lo:1000: 00000100:00100000:1.0:1789181254.890569:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f53b9c78 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1876092408309248:12345-0@lo:1000: Request processed in 65us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181254.890575:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181254.890646:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1876092408309248:0@lo:1000: 00000040:00080000:0.0:1789181254.890664:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789181254.890703:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000060cf0cd1 with version 1 00000004:00080000:2.0:1789181254.891675:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000009fa945fe version 1 rpc_version 1 00000020:00100000:2.0:1789181254.891718:0:7466:0:(genops.c:2429:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789181254.891752:0:7466:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000011445c62 x1876092408309504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789181254.891771:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011445c62 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1876092408309504:0@lo:1000: 00000100:00100000:2.0:1789181254.891834:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181254.891866:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036a7fe6d going to sleep for 11 seconds 00000100:00100000:1.0:1789181254.893482:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408309504 00000100:00100000:1.0:1789181254.893496:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408309504 00000100:00100000:1.0:1789181254.893555:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789181254.893563:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ecb4939 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1876092408309504:12345-0@lo:1000: 00100000:10000000:2.0:1789181254.894252:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000100:00100000:3.0:1789181254.895225:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3d8aa73 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1876092408308352:12345-0@lo:700: Request processed in 33126us (33457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181254.895242:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789181254.895302:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000055cbc67d x1876092408308352/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789181270 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181254.895316:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876092408308352:0@lo:700: 00100000:10000000:2.0:1789181254.895714:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789181254.895887:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789181254.896016:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 40000000:02000000:3.0:1789181254.896181:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00000004:2.0:1789181254.897782:0:7450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789181254.901185:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789181254.901271:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:2.0:1789181254.909234:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1789181254.909489:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ecb4939 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1876092408309504:12345-0@lo:1000: Request processed in 15924us (17651us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789181254.909506:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:0.0:1789181254.910906:0:7450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789181254.910943:0:7450:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa94545577988 00100000:10000000:0.0:1789181254.910951:0:7450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789181254.911699:0:7450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789181254.911766:0:7450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789181254.911790:0:7450:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789181254.911809:0:7450:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789181254.912937:0:7450:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181254.913304:0:7450:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000004:00080000:2.0:1789181254.918625:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789181254.918642:0:7466:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789181254.918681:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011445c62 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1876092408309504:0@lo:1000: 00000040:00080000:0.0:1789181254.972415:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181254.998541:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789181254.998622:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789181254.998628:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1789181255.180501:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181256.203893:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181257.231502:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181258.251853:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789181258.820307:0:7721:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789181259.278698:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789181259.966046:0:7773:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181259.966281:0:7773:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789181260.043946:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408309632:0@lo:400: 00000100:00100000:0.0:1789181260.044023:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181260.044072:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181260.044076:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d1ac1f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408310016:0@lo:400: 00000100:00100000:0.0:1789181260.044115:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181260.044137:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001335ad22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408309760:0@lo:400: 00000100:00100000:0.0:1789181260.044150:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181260.044162:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181260.044165:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000086902b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408309888:0@lo:400: 00000100:00100000:0.0:1789181260.044179:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181260.044198:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408309632 00000100:00100000:0.0:1789181260.044205:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408309632 00000100:00100000:0.0:1789181260.044240:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789181260.044246:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000075b4b3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+13:3646:x1876092408309632:12345-0@lo:400: 00000100:00100000:0.0:1789181260.044282:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000075b4b3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+13:3646:x1876092408309632:12345-0@lo:400: Request processed in 37us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181260.044287:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789181260.044310:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408310016 00000100:00100000:0.0:1789181260.044312:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408310016 00000100:00100000:1.0:1789181260.044404:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408309888 00000100:00100000:1.0:1789181260.044409:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408309888 00000100:00100000:1.0:1789181260.044444:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789181260.044463:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa45e905 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408309888:12345-0@lo:400: 00000100:00100000:1.0:1789181260.044512:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa45e905 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408309888:12345-0@lo:400: Request processed in 62us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181260.044518:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789181260.044556:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000086902b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408309888:0@lo:400: 00000100:00100000:0.0:1789181260.045795:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408309760 00000100:00100000:0.0:1789181260.045804:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408309760 00000100:00100000:0.0:1789181260.045831:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181260.045838:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000181368de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408310016:12345-0@lo:400: 00000100:00100000:0.0:1789181260.045892:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000181368de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408310016:12345-0@lo:400: Request processed in 55us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181260.045898:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181260.045912:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181260.045917:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bcd4172d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408309760:12345-0@lo:400: 00000100:00100000:0.0:1789181260.045953:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bcd4172d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408309760:12345-0@lo:400: Request processed in 37us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181260.045959:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181260.045996:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181260.046008:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011445c62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408310144:0@lo:41: 00010000:00080000:2.0:1789181260.046742:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001335ad22 x1876092408309760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181260.046754:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001335ad22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408309760:0@lo:400: 00000100:00100000:0.0:1789181260.048196:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789181260.048266:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002d1ac1f5 x1876092408310016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181260.048281:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d1ac1f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408310016:0@lo:400: 00000100:00100000:0.0:1789181260.048295:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408309632:0@lo:400: 00000100:00100000:1.0:1789181260.048912:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408310144 00000100:00100000:1.0:1789181260.048929:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408310144 00000100:00100000:1.0:1789181260.048985:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181260.048993:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000032041dce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408310144:12345-0@lo:41: 00000004:00000024:1.0:1789181260.049026:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789181260.049107:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000032041dce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408310144:12345-0@lo:41: Request processed in 115us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181260.049115:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789181260.049662:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011445c62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408310144:0@lo:41: 00010000:00010000:1.0:1789181260.301705:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181261.323981:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181262.350766:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789181262.604675:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789181262.604682:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1df1a64800 from 4 10000000:01000000:3.0:1789181262.604686:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789181262.605292:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000007f16fb40/0x76fb555283516c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181262.605304:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000007f16fb40/0x76fb555283516c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181262.605323:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000007f16fb40/0x76fb555283516c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181262.605345:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408310272:0@lo:101: 00000100:00100000:3.0:1789181262.605414:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181262.605551:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061a984d1 going to sleep for 11 seconds 00000100:00100000:0.0:1789181262.609286:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408310272 00000100:00100000:0.0:1789181262.609303:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408310272 00000100:00100000:0.0:1789181262.609399:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789181262.609408:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047bc4f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+13:6518:x1876092408310272:12345-0@lo:101: 00010000:00010000:0.0:1789181262.609427:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181262.609447:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b53c296a/0x76fb555283516c99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516c92 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.609481:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b53c296a/0x76fb555283516c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516c92 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.609491:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b53c296a/0x76fb555283516c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516c92 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.609499:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b53c296a, rc 0) 00000100:00100000:0.0:1789181262.609582:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047bc4f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+14:6518:x1876092408310272:12345-0@lo:101: Request processed in 176us (4169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181262.609589:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789181262.609680:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408310272:0@lo:101: 00010000:00010000:3.0:1789181262.609696:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000007f16fb40/0x76fb555283516c92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181262.609704:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000007f16fb40/0x76fb555283516c92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181262.609779:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408310400:0@lo:256: 00000100:00100000:3.0:1789181262.609812:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.614962:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408310400 00000100:00100000:1.0:1789181262.614975:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408310400 00000100:00100000:1.0:1789181262.615023:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789181262.615031:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ccc918d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:6518:x1876092408310400:12345-0@lo:256: 20000000:01000000:1.0:1789181262.615056:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789181262.615074:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789181262.615077:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789181262.615215:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ccc918d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:6518:x1876092408310400:12345-0@lo:256: Request processed in 185us (5402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.615224:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181262.615458:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061a984d1 going to sleep for 11 seconds 00000100:00100000:2.0:1789181262.615483:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408310400:0@lo:256: 10000000:01000000:2.0:1789181262.615540:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789181262.615548:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000007f16fb40/0x76fb555283516c92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181262.615558:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000007f16fb40/0x76fb555283516c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181262.615569:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789181262.615571:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1dc32aa000 from 21 10000000:01000000:2.0:1789181262.615574:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789181262.615602:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181262.615609:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181262.615628:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181262.615651:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011445c62 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408310528:0@lo:101: 00000100:00100000:2.0:1789181262.615684:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181262.615712:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc9e8f03 going to sleep for 11 seconds 00000100:00100000:1.0:1789181262.616002:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408310528 00000100:00100000:1.0:1789181262.616007:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408310528 00000100:00100000:1.0:1789181262.616029:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789181262.616035:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c14c0c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:6518:x1876092408310528:12345-0@lo:101: 00010000:00010000:1.0:1789181262.616045:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181262.616055:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a52620bc/0x76fb555283516ca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516ca0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.616074:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a52620bc/0x76fb555283516ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516ca0 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.616094:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a52620bc/0x76fb555283516ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ca0 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.616102:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a52620bc, rc 0) 00000100:00100000:1.0:1789181262.616137:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c14c0c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408310528:12345-0@lo:101: Request processed in 102us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.616143:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789181262.616185:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011445c62 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408310528:0@lo:101: 00010000:00010000:1.0:1789181262.616196:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516ca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.616203:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516ca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181262.616253:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007aa4706a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408310656:0@lo:501: 00000100:00100000:1.0:1789181262.616275:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.616292:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0d52359 going to sleep for 11 seconds 00000100:00100000:1.0:1789181262.616302:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408310656 00000100:00100000:1.0:1789181262.616305:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408310656 00000100:00100000:1.0:1789181262.616320:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789181262.616324:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000147b72dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408310656:12345-0@lo:501: 00000100:00100000:1.0:1789181262.616431:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000147b72dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408310656:12345-0@lo:501: Request processed in 106us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.616437:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789181262.616460:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007aa4706a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408310656:0@lo:501: 00000100:00100000:1.0:1789181262.616485:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007aa4706a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408310784:0@lo:503: 00000100:00100000:1.0:1789181262.616521:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.616533:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0d52359 going to sleep for 11 seconds 00000100:00100000:1.0:1789181262.616543:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408310784 00000100:00100000:1.0:1789181262.616546:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408310784 00000100:00100000:1.0:1789181262.616560:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789181262.616564:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d44f6720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408310784:12345-0@lo:503: 00000100:00100000:1.0:1789181262.616655:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d44f6720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408310784:12345-0@lo:503: Request processed in 90us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.616662:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789181262.616698:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007aa4706a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408310784:0@lo:503: 00000100:00100000:1.0:1789181262.621586:0:7849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007aa4706a pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:7849:1876092408310912:0@lo:502: 00000100:00100000:1.0:1789181262.621682:0:7849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.621755:0:7849:0:(client.c:2716:ptlrpc_set_wait()) set 000000003a48df88 going to sleep for 11 seconds 00000100:00100000:0.0:1789181262.621850:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408310912 00000100:00100000:0.0:1789181262.621858:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408310912 00000100:00100000:0.0:1789181262.621970:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789181262.621979:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b529bc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:7849:x1876092408310912:12345-0@lo:502: 00000100:00100000:0.0:1789181262.622105:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b529bc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:7849:x1876092408310912:12345-0@lo:502: Request processed in 128us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181262.622113:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789181262.622275:0:7849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007aa4706a pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:7849:1876092408310912:0@lo:502: 00000100:00100000:3.0:1789181262.622321:0:7849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0db831 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:7849:1876092408311040:0@lo:502: 00000100:00100000:3.0:1789181262.622352:0:7849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181262.622368:0:7849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c2f08728 going to sleep for 11 seconds 00000100:00100000:1.0:1789181262.622468:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408311040 00000100:00100000:1.0:1789181262.622472:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408311040 00000100:00100000:1.0:1789181262.622505:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789181262.622511:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000099da191f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:7849:x1876092408311040:12345-0@lo:502: 00000100:00100000:1.0:1789181262.622576:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000099da191f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:7849:x1876092408311040:12345-0@lo:502: Request processed in 65us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.622582:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789181262.622654:0:7849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0db831 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:7849:1876092408311040:0@lo:502: 00000040:00080000:3.0:1789181262.622673:0:7849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789181262.623038:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789181262.623059:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789181262.623067:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516ca0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.623078:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000f908a90f/0x76fb555283516ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181262.623098:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789181262.623100:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1dc32aa000 from 4 10000000:01000000:1.0:1789181262.623103:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789181262.623127:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000f5a79a52/0x76fb555283516cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.623135:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000f5a79a52/0x76fb555283516cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.623143:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000f5a79a52/0x76fb555283516cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181262.623260:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004b874cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408311168:0@lo:101: 00000100:00100000:1.0:1789181262.623291:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.623354:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a9cbf67 going to sleep for 11 seconds 00000100:00100000:0.0:1789181262.634272:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408311168 00000100:00100000:0.0:1789181262.634287:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408311168 00000100:00100000:0.0:1789181262.634340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789181262.634348:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008705fdd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408311168:12345-0@lo:101: 00010000:00010000:0.0:1789181262.634366:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181262.634392:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e5a67f2/0x76fb555283516cb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516cae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.634420:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e5a67f2/0x76fb555283516cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516cae expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.634430:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e5a67f2/0x76fb555283516cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516cae expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.634439:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e5a67f2, rc 0) 00000100:00100000:0.0:1789181262.634508:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008705fdd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408311168:12345-0@lo:101: Request processed in 160us (11216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181262.634514:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789181262.634659:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004b874cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408311168:0@lo:101: 00010000:00010000:1.0:1789181262.634677:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000f5a79a52/0x76fb555283516cae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.634685:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000f5a79a52/0x76fb555283516cae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181262.635550:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004b874cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408311296:0@lo:256: 00000100:00100000:1.0:1789181262.635602:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.636285:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a9cbf67 going to sleep for 11 seconds 00000100:00100000:0.0:1789181262.636570:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408311296 00000100:00100000:0.0:1789181262.636579:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408311296 00000100:00100000:0.0:1789181262.636638:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789181262.636647:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbcf51bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408311296:12345-0@lo:256: 20000000:01000000:0.0:1789181262.636668:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789181262.636688:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789181262.636691:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789181262.636811:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbcf51bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408311296:12345-0@lo:256: Request processed in 165us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181262.636819:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789181262.636847:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004b874cf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408311296:0@lo:256: 10000000:01000000:0.0:1789181262.636887:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789181262.637064:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 00000000f5a79a52/0x76fb555283516cae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.637075:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 00000000f5a79a52/0x76fb555283516cae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181262.637084:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789181262.637086:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789181262.637089:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789181262.637115:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 0000000051ad2657/0x76fb555283516cbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.637122:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 0000000051ad2657/0x76fb555283516cbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.637130:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 0000000051ad2657/0x76fb555283516cbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181262.637155:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408311424:0@lo:101: 00000100:00100000:0.0:1789181262.637185:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181262.637213:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba880407 going to sleep for 11 seconds 00000100:00100000:0.0:1789181262.637230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408311424 00000100:00100000:0.0:1789181262.637234:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408311424 00000100:00100000:0.0:1789181262.637257:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789181262.637262:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4165f4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408311424:12345-0@lo:101: 00010000:00010000:0.0:1789181262.637270:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181262.637280:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000009ba3eef/0x76fb555283516cc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516cbc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.637298:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009ba3eef/0x76fb555283516cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516cbc expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.637306:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000009ba3eef/0x76fb555283516cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516cbc expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.637313:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000009ba3eef, rc 0) 00000100:00100000:0.0:1789181262.637340:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4165f4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408311424:12345-0@lo:101: Request processed in 78us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181262.637346:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789181262.637367:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408311424:0@lo:101: 00010000:00010000:0.0:1789181262.637475:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 0000000051ad2657/0x76fb555283516cbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181262.637484:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 0000000051ad2657/0x76fb555283516cbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181262.637548:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408311552:0@lo:501: 00000100:00100000:0.0:1789181262.637572:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181262.637593:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba880407 going to sleep for 11 seconds 00000100:00100000:0.0:1789181262.637607:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408311552 00000100:00100000:0.0:1789181262.637611:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408311552 00000100:00100000:0.0:1789181262.637637:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789181262.637647:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fdbf42ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408311552:12345-0@lo:501: 00000100:00100000:0.0:1789181262.637842:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fdbf42ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408311552:12345-0@lo:501: Request processed in 195us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181262.637849:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789181262.637869:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408311552:0@lo:501: 00000100:00100000:0.0:1789181262.638011:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408311680:0@lo:503: 00000100:00100000:0.0:1789181262.638049:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181262.638108:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba880407 going to sleep for 11 seconds 00000100:00100000:0.0:1789181262.638125:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408311680 00000100:00100000:0.0:1789181262.638129:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408311680 00000100:00100000:0.0:1789181262.638147:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789181262.638153:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9bc2846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408311680:12345-0@lo:503: 00000100:00100000:0.0:1789181262.638231:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9bc2846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408311680:12345-0@lo:503: Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181262.638238:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789181262.638266:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408311680:0@lo:503: 00000100:00100000:0.0:1789181262.638536:0:7851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:7851:1876092408311808:0@lo:502: 00000100:00100000:0.0:1789181262.638569:0:7851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181262.638587:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408311808 00000100:00100000:0.0:1789181262.638591:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408311808 00000100:00100000:0.0:1789181262.638609:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789181262.638626:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e288fae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:7851:x1876092408311808:12345-0@lo:502: 00000100:00100000:0.0:1789181262.638687:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e288fae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:7851:x1876092408311808:12345-0@lo:502: Request processed in 74us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181262.638694:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789181262.638852:0:7851:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de5f33ee going to sleep for 11 seconds 00000100:00100000:0.0:1789181262.638865:0:7851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:7851:1876092408311808:0@lo:502: 00000020:01000000:0.0:1789181262.638884:0:7851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181262.638959:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181262.638962:0:7851:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789181262.638967:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789181262.638971:0:7851:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:00000080:0.0:1789181262.638993:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181262.639008:0:7851:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000f75a65ed) 00000020:00000080:0.0:1789181262.639028:0:7851:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1789181262.639034:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789181262.639106:0:7851:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789181262.639112:0:7851:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789181262.639118:0:7851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283516cd1 00010000:00080000:0.0:1789181262.639157:0:7851:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c620bc62@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1789181262.643282:0:7851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789181262.653313:0:7851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789181262.653328:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789181262.653389:0:7851:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789181262.653412:0:7851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb555283516cd8 00000100:00080000:1.0:1789181262.653423:0:7851:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181262.653432:0:7851:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000c620bc62 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181262.653467:0:7851:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e5505cf7 x1876092408311936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181262.653500:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5505cf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408311936:0@lo:38: 00000100:00100000:1.0:1789181262.653562:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.653635:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408311936 00000100:00100000:1.0:1789181262.653643:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408311936 00000100:00100000:1.0:1789181262.653675:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181262.653681:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000631fccfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876092408311936:12345-0@lo:38: 00010000:00080000:1.0:1789181262.653705:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1789181262.653751:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb555283516cdf 00000004:00100000:1.0:1789181262.653766:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789181262.653772:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789181262.653838:0:7851:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789181262.656349:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408312320:0@lo:400: 00000100:00100000:1.0:1789181262.656415:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.656463:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408312320 00000100:00100000:1.0:1789181262.656469:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408312320 00000100:00100000:1.0:1789181262.656507:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789181262.656513:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a923f54b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408312320:12345-0@lo:400: 00000100:00100000:1.0:1789181262.656559:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a923f54b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408312320:12345-0@lo:400: Request processed in 46us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.656566:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789181262.656604:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000127a90e6 x1876092408312320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181262.656640:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408312320:0@lo:400: 00000040:01000000:1.0:1789181262.656678:0:7851:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1789181262.656829:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed09e98c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408312192:0@lo:400: 00000100:00100000:3.0:1789181262.656861:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181262.656880:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181262.656885:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007d1123ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408312064:0@lo:400: 00000100:00100000:3.0:1789181262.656921:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181262.656944:0:6527:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789181262.656951:0:6527:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789181262.656964:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408312064 00000100:00100000:3.0:1789181262.656967:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408312064 00000100:00100000:3.0:1789181262.656990:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181262.656995:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073c18dac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408312064:12345-0@lo:400: 00000100:00100000:3.0:1789181262.657023:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073c18dac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408312064:12345-0@lo:400: Request processed in 29us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181262.657029:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789181262.657120:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007d1123ab x1876092408312064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181262.657130:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007d1123ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408312064:0@lo:400: 00000100:00100000:3.0:1789181262.657634:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408312192 00000100:00100000:3.0:1789181262.657639:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408312192 00000100:00080000:1.0:1789181262.658110:0:7855:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000127a90e6 x1876092408312448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181262.658121:0:7855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e77e8bf9 going to sleep for 0 seconds 00000020:01000000:3.0:1789181262.658196:0:7851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181262.658201:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181262.658203:0:7851:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789181262.658206:0:7851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181262.658209:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181262.658211:0:7851:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789181262.658213:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789181262.658215:0:7851:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789181262.658233:0:7851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a8963b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:7851:1876092408312576:0@lo:502: 00000100:00100000:3.0:1789181262.658282:0:7851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181262.658313:0:7851:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2c94b14 going to sleep for 11 seconds 00000100:00100000:1.0:1789181262.659470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408312576 00000100:00100000:1.0:1789181262.659477:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408312576 00000100:00100000:1.0:1789181262.659519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789181262.659526:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a11b766 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:7851:x1876092408312576:12345-0@lo:502: 00000100:00100000:1.0:1789181262.659661:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a11b766 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:7851:x1876092408312576:12345-0@lo:502: Request processed in 136us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.659669:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789181262.659715:0:7851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a8963b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:7851:1876092408312576:0@lo:502: 00000020:01000000:1.0:1789181262.659823:0:7851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181262.659828:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181262.659830:0:7851:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789181262.659833:0:7851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789181262.659955:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789181262.659976:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789181262.659984:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 0000000051ad2657/0x76fb555283516cbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.659995:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 0000000051ad2657/0x76fb555283516cbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181262.660005:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789181262.660008:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c1dd13ecd40 from 1 10000000:01000000:1.0:1789181262.660017:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789181262.660040:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 000000009380df44/0x76fb555283516ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.660047:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 000000009380df44/0x76fb555283516ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.660056:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 000000009380df44/0x76fb555283516ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181262.660070:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a75d8ebf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408312704:0@lo:101: 00000100:00100000:1.0:1789181262.660101:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.660121:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000000255616b going to sleep for 11 seconds 00000100:00100000:1.0:1789181262.660135:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408312704 00000100:00100000:1.0:1789181262.660139:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408312704 00000100:00100000:1.0:1789181262.660161:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789181262.660167:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058796e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408312704:12345-0@lo:101: 00010000:00010000:1.0:1789181262.660175:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181262.660186:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2a43f79/0x76fb555283516ced lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516ce6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.660209:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2a43f79/0x76fb555283516ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516ce6 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.660219:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2a43f79/0x76fb555283516ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ce6 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.660227:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2a43f79, rc 0) 00000100:00100000:1.0:1789181262.660255:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058796e1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408312704:12345-0@lo:101: Request processed in 88us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.660268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789181262.660299:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a75d8ebf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408312704:0@lo:101: 00010000:00010000:1.0:1789181262.660309:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 000000009380df44/0x76fb555283516ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.660317:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 000000009380df44/0x76fb555283516ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181262.660361:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a75d8ebf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408312832:0@lo:501: 00000100:00100000:1.0:1789181262.661493:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.662853:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000000255616b going to sleep for 11 seconds 00000100:00100000:1.0:1789181262.666646:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789181262.666667:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb0db831 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408312192:12345-0@lo:400: 00000100:00100000:1.0:1789181262.666811:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb0db831 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408312192:12345-0@lo:400: Request processed in 152us (9950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.666820:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181262.668503:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408312832 00000100:00100000:3.0:1789181262.668518:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408312832 00000100:00100000:3.0:1789181262.668562:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed09e98c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408312192:0@lo:400: 00000100:00100000:3.0:1789181262.668658:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181262.668666:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081f52951 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408312832:12345-0@lo:501: 00000100:00100000:3.0:1789181262.670317:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081f52951 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408312832:12345-0@lo:501: Request processed in 1647us (8822us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789181262.670329:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789181262.672111:0:6526:0:(import.c:65:import_set_state_nolock()) 000000005d635fb8 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181262.672196:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000631fccfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876092408311936:12345-0@lo:38: Request processed in 18512us (18632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181262.672206:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181262.672270:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181262.672281:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789181262.672289:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789181262.672294:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789181262.672296:0:3642:0:(import.c:65:import_set_state_nolock()) 00000000c620bc62 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789181262.672310:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e77e8bf9): req@00000000127a90e6 x1876092408312448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181262.672325:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5505cf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408311936:0@lo:38: 00000100:00100000:3.0:1789181262.672456:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087970216 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408312960:0@lo:41: 00000100:00100000:3.0:1789181262.672495:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181262.672536:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408312960 00000100:00100000:3.0:1789181262.672542:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408312960 00000100:00100000:3.0:1789181262.672574:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181262.672581:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a8963b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408312960:12345-0@lo:41: 00000004:00000024:3.0:1789181262.672605:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789181262.672649:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a8963b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408312960:12345-0@lo:41: Request processed in 69us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181262.672665:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181262.672696:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087970216 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408312960:0@lo:41: 00000100:00100000:1.0:1789181262.672855:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a75d8ebf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408312832:0@lo:501: 10000000:01000000:1.0:1789181262.672958:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789181262.672968:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: 000000009380df44/0x76fb555283516ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181262.672979:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: 000000009380df44/0x76fb555283516ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181262.673034:0:7855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.673055:0:7855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e77e8bf9 going to sleep for 11 seconds 00000100:00100000:3.0:1789181262.673106:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408312448 00000100:00100000:3.0:1789181262.673110:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408312448 00000100:00100000:3.0:1789181262.673165:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181262.673172:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a75d8ebf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7855:x1876092408312448:12345-0@lo:1000: 00000100:00100000:3.0:1789181262.673237:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a75d8ebf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7855:x1876092408312448:12345-0@lo:1000: Request processed in 65us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181262.673244:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181262.679879:0:7855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408312448:0@lo:1000: 00000040:01000000:1.0:1789181262.679942:0:7855:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789181262.679990:0:7855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408313088:0@lo:1000: 00000100:00100000:1.0:1789181262.680053:0:7855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.680090:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408313088 00000100:00100000:1.0:1789181262.680097:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408313088 00000100:00100000:1.0:1789181262.680140:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181262.680149:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e5505cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7855:x1876092408313088:12345-0@lo:1000: 00000100:00100000:1.0:1789181262.680265:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e5505cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7855:x1876092408313088:12345-0@lo:1000: Request processed in 117us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.680273:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181262.680295:0:7855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e77e8bf9 going to sleep for 11 seconds 00000100:00100000:1.0:1789181262.680306:0:7855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408313088:0@lo:1000: 00000100:00100000:1.0:1789181262.680343:0:7855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408313216:0@lo:700: 00000100:00100000:1.0:1789181262.680367:0:7855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.680403:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408313216 00000100:00100000:1.0:1789181262.680407:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408313216 00000100:00100000:1.0:1789181262.680486:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181262.680493:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed09e98c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7855:x1876092408313216:12345-0@lo:700: 00000100:00100000:1.0:1789181262.680525:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed09e98c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7855:x1876092408313216:12345-0@lo:700: Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.680531:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181262.680546:0:7855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000843cdd2c going to sleep for 11 seconds 00000100:00100000:1.0:1789181262.680558:0:7855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408313216:0@lo:700: 00000100:00100000:1.0:1789181262.680710:0:7855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408313344:0@lo:1000: 00000100:00100000:1.0:1789181262.680764:0:7855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.680792:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408313344 00000100:00100000:1.0:1789181262.680796:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408313344 00000100:00100000:1.0:1789181262.680815:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181262.680821:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d1123ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7855:x1876092408313344:12345-0@lo:1000: 00000100:00100000:1.0:1789181262.680868:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d1123ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7855:x1876092408313344:12345-0@lo:1000: Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181262.680874:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181262.680889:0:7855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000085f5e18 going to sleep for 11 seconds 00000100:00100000:1.0:1789181262.680900:0:7855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408313344:0@lo:1000: 00000004:00080000:1.0:1789181262.680938:0:7855:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000843cdd2c with version 0 00000020:00100000:1.0:1789181262.680953:0:7855:0:(genops.c:2429:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789181262.680960:0:7855:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000127a90e6 x1876092408313600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181262.680972:0:7855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408313600:0@lo:1000: 00000100:00100000:1.0:1789181262.680994:0:7855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181262.681011:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408313600 00000100:00100000:1.0:1789181262.681014:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408313600 00000100:00100000:1.0:1789181262.681032:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181262.681037:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004b874cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7855:x1876092408313600:12345-0@lo:1000: 00000100:00100000:1.0:1789181262.681336:0:7855:0:(client.c:2716:ptlrpc_set_wait()) set 000000000255616b going to sleep for 11 seconds 00000001:00080000:0.0:1789181262.700504:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1789181262.700518:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789181262.700650:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004b874cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7855:x1876092408313600:12345-0@lo:1000: Request processed in 19608us (19652us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789181262.700663:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1789181262.701185:0:7855:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789181262.701258:0:7855:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789181262.701276:0:7855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408313600:0@lo:1000: 00000100:00100000:1.0:1789181262.701361:0:7855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408313728:0@lo:1000: 00000100:00100000:1.0:1789181262.701689:0:7855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181262.701880:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408313728 00000100:00100000:0.0:1789181262.701888:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408313728 00000100:00100000:1.0:1789181262.702517:0:7855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e77e8bf9 going to sleep for 11 seconds 00000100:00100000:0.0:1789181262.703046:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789181262.703057:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007aa4706a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7855:x1876092408313728:12345-0@lo:1000: 00000100:00100000:0.0:1789181262.703174:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007aa4706a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7855:x1876092408313728:12345-0@lo:1000: Request processed in 119us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181262.703181:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789181262.703440:0:7855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7855:1876092408313728:0@lo:1000: 00000040:00080000:1.0:1789181262.703465:0:7855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789181262.703499:0:7855:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000843cdd2c with version 1 00000004:00080000:0.0:1789181262.703693:0:7852:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000c3783fc6 version 1 rpc_version 1 00000020:00100000:0.0:1789181262.703719:0:7852:0:(genops.c:2429:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789181262.703742:0:7852:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005cff9939 x1876092408313984/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789181262.703762:0:7852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7852:1876092408313984:0@lo:1000: 00000100:00100000:0.0:1789181262.703800:0:7852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181262.703820:0:7852:0:(client.c:2716:ptlrpc_set_wait()) set 000000004519cc67 going to sleep for 11 seconds 00000100:00100000:0.0:1789181262.703833:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408313984 00000100:00100000:0.0:1789181262.703838:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408313984 00000100:00100000:0.0:1789181262.703863:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789181262.703869:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d1ac1f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7852:x1876092408313984:12345-0@lo:1000: 00000001:00080000:0.0:1789181262.708514:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789181262.709369:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d1ac1f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7852:x1876092408313984:12345-0@lo:1000: Request processed in 5493us (5562us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789181262.709393:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1789181262.709396:0:7852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789181262.709400:0:7852:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789181262.709417:0:7852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7852:1876092408313984:0@lo:1000: 00000040:00080000:1.0:1789181262.714184:0:7855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789181262.714667:0:7855:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789181262.714672:0:7855:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1789181263.096590:0:7881:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789181263.105994:0:7881:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789181263.375982:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789181264.275546:0:7929:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff29f169a0 20000000:00000080:0.0:1789181264.275564:0:7929:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c1dfb1cc800 uarg=0000000000000000 20000000:01000000:0.0:1789181264.275617:0:7929:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789181264.275623:0:7929:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789181264.275628:0:7929:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789181264.275711:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789181264.275747:0:7929:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789181264.284073:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181264.284281:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789181264.284306:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789181264.284315:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789181264.284329:0:7929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789181264.284345:0:7929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181264.284374:0:7929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000588113e7/0x76fb555283516b73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516b6c expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181264.284381:0:7929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bdba800c/0x76fb555283516c61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516c5a expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181264.284387:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181264.284696:0:7929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bdba800c/0x76fb555283516c61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516c5a expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181264.284710:0:7929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bdba800c/0x76fb555283516c61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516c5a expref: 17 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181264.284762:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1876092408314112:0@lo:104: 00000100:00100000:0.0:1789181264.289149:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181264.289230:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789181264.289251:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408314112 00010000:00010000:0.0:1789181264.289251:0:7929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000588113e7/0x76fb555283516b73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516b6c expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181264.289258:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408314112 00010000:00010000:0.0:1789181264.289266:0:7929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000588113e7/0x76fb555283516b73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516b6c expref: 17 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181264.289279:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1876092408314240:0@lo:104: 00000100:00100000:1.0:1789181264.289308:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181264.289310:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181264.289315:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000092fc0bdb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+3:7929:x1876092408314112:12345-0@lo:104: 00000100:00100000:0.0:1789181264.289320:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set 000000004519cc67 going to sleep for 11 seconds 00010000:00010000:1.0:1789181264.289328:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289399:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789181264.289405:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000092fc0bdb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+3:7929:x1876092408314112:12345-0@lo:104: Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181264.289411:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181264.289420:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408314240 00000100:00100000:3.0:1789181264.289425:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408314240 00000100:00100000:3.0:1789181264.289444:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181264.289448:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e485715d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:7929:x1876092408314240:12345-0@lo:104: 00010000:00010000:3.0:1789181264.289455:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289466:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181264.289471:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289478:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d9ae80d0 already unused, calling callback (00000000517fa998) 10000000:00010000:1.0:1789181264.289481:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181264.289487:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789181264.289488:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181264.289491:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e485715d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:7929:x1876092408314240:12345-0@lo:104: Request processed in 43us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181264.289496:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 10000000:00010000:1.0:1789181264.289520:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181264.289526:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789181264.289554:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289560:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181264.289587:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289595:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000d9ae80d0/0x76fb555283516c5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c61 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289618:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181264.289620:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289625:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d9cbf97f already unused, calling callback (00000000517fa998) 10000000:00010000:1.0:1789181264.289627:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289633:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181264.289639:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181264.289644:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789181264.289652:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181264.289676:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181264.289677:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cff9939 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1876092408314112:0@lo:104: 00010000:00010000:1.0:1789181264.289683:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789181264.289685:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b5deb16 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1876092408314240:0@lo:104: 00010000:00010000:1.0:1789181264.289687:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289693:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: 00000000d9cbf97f/0x76fb555283516b6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516b73 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289706:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181264.289708:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181264.289708:0:7929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.289709:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181264.289833:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408314368:0@lo:103: 00000100:00100000:3.0:1789181264.289863:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181264.289900:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408314368 00000100:00100000:3.0:1789181264.289903:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408314368 00010000:00010000:3.0:1789181264.289918:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bdba800c/0x76fb555283516c61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516c5a expref: 18 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181264.289951:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181264.289956:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087970216 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da575344-f445-48a7-8532-0e6efd2ea878+18:3643:x1876092408314368:12345-0@lo:103: 00010000:00010000:3.0:1789181264.289967:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181264.289970:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bdba800c/0x76fb555283516c61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516c5a expref: 18 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181264.289979:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bdba800c/0x76fb555283516c61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516c5a expref: 18 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181264.289990:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bdba800c/0x76fb555283516c61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516c5a expref: 18 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181264.290001:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181264.290026:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087970216 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da575344-f445-48a7-8532-0e6efd2ea878+17:3643:x1876092408314368:12345-0@lo:103: Request processed in 71us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181264.290032:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181264.290069:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000127a90e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408314368:0@lo:103: 00000100:00100000:1.0:1789181264.291619:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ea41ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408314496:0@lo:103: 00000100:00100000:2.0:1789181264.291706:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181264.291932:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408314496 00000100:00100000:1.0:1789181264.291939:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408314496 00010000:00010000:1.0:1789181264.292027:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000588113e7/0x76fb555283516b73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516b6c expref: 17 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181264.292054:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789181264.292062:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000826b27c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+17:3644:x1876092408314496:12345-0@lo:103: 00010000:00010000:1.0:1789181264.292164:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181264.292169:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000588113e7/0x76fb555283516b73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516b6c expref: 17 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292176:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000588113e7/0x76fb555283516b73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516b6c expref: 17 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292187:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000588113e7/0x76fb555283516b73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516b6c expref: 17 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292208:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292214:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292225:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292229:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292233:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292236:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292239:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aea1e38a already unused, calling callback (0000000017e9db8a) 00010000:00010000:1.0:1789181264.292242:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292246:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292257:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181264.292266:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181264.292280:0:7929:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181264.292288:0:7929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181264.292294:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aea1e38a/0x76fb555283516cf4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181264.292310:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000826b27c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+16:3644:x1876092408314496:12345-0@lo:103: Request processed in 250us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181264.292324:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181264.292457:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ea41ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408314496:0@lo:103: 00010000:00010000:2.0:1789181264.398941:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181265.170787:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181265.170813:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8880032 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408314624:0@lo:41: 00000100:00100000:0.0:1789181265.170887:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181265.170955:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408314624 00000100:00100000:0.0:1789181265.170963:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408314624 00000100:00100000:0.0:1789181265.171008:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181265.171016:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b5deb16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408314624:12345-0@lo:41: 00000004:00000024:0.0:1789181265.171049:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789181265.171094:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b5deb16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408314624:12345-0@lo:41: Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181265.171100:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181265.171145:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8880032 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408314624:0@lo:41: 00010000:00010000:1.0:1789181265.422291:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181266.444001:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181267.468983:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181267.725157:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408314752:0@lo:400: 00000100:00100000:0.0:1789181267.725250:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181267.725937:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408314752 00000100:00100000:2.0:1789181267.725947:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408314752 00000100:00100000:2.0:1789181267.725996:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789181267.726005:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe9bf2d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:3646:x1876092408314752:12345-0@lo:400: 00000100:00100000:0.0:1789181267.726102:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408315264:0@lo:41: 00000100:00100000:0.0:1789181267.726170:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181267.726352:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5cd1c81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408314880:0@lo:400: 00000100:00100000:1.0:1789181267.726609:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181267.726636:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181267.726641:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8880032 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408315008:0@lo:400: 00000100:00100000:1.0:1789181267.726677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181267.726705:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408314880 00000100:00100000:1.0:1789181267.726709:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408314880 00000100:00100000:1.0:1789181267.726760:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789181267.726766:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000127a90e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408314880:12345-0@lo:400: 00000100:00100000:1.0:1789181267.726800:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000127a90e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408314880:12345-0@lo:400: Request processed in 34us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181267.726807:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789181267.726828:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408315264 00000100:00100000:1.0:1789181267.726832:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408315264 00000100:00100000:1.0:1789181267.726850:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408315008 00000100:00100000:1.0:1789181267.726852:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408315008 00000100:00100000:1.0:1789181267.726862:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181267.726866:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005cff9939 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408315264:12345-0@lo:41: 00000004:00000024:1.0:1789181267.726895:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789181267.726928:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005cff9939 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408315264:12345-0@lo:41: Request processed in 61us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181267.726933:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181267.726945:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181267.726951:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000513190d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408315008:12345-0@lo:400: 00000100:00100000:1.0:1789181267.726988:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000513190d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408315008:12345-0@lo:400: Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181267.726994:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181267.727032:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8880032 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408315008:0@lo:400: 00010000:00080000:1.0:1789181267.727044:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c5cd1c81 x1876092408314880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181267.727053:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5cd1c81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408314880:0@lo:400: 00000100:00100000:2.0:1789181267.728625:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe9bf2d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:3646:x1876092408314752:12345-0@lo:400: Request processed in 2617us (3371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181267.728640:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789181267.728693:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ea41ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408315136:0@lo:400: 00000100:00100000:2.0:1789181267.731504:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181267.731630:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408315136 00000100:00100000:3.0:1789181267.731639:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408315136 00000100:00100000:3.0:1789181267.731696:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181267.731705:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007dc78b8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408315136:12345-0@lo:400: 00000100:00100000:3.0:1789181267.731804:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007dc78b8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408315136:12345-0@lo:400: Request processed in 100us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181267.731812:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789181267.731856:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a8ea41ec x1876092408315136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181267.731895:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ea41ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408315136:0@lo:400: 00000100:00100000:0.0:1789181267.735951:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1e1f822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408314752:0@lo:400: 00000100:00100000:0.0:1789181267.736016:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055cbc67d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408315264:0@lo:41: 00010000:00010000:0.0:1789181268.492602:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181269.519300:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181270.283902:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c718fd34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408315392:0@lo:41: 00000100:00100000:2.0:1789181270.283980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181270.284109:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408315392 00000100:00100000:1.0:1789181270.284119:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408315392 00000100:00100000:1.0:1789181270.284169:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789181270.284176:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001da9764d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408315392:12345-0@lo:41: 00000004:00000024:1.0:1789181270.284206:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789181270.284257:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001da9764d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408315392:12345-0@lo:41: Request processed in 82us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181270.284261:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789181270.284316:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c718fd34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408315392:0@lo:41: 00010000:00010000:0.0:1789181270.549471:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789181270.797361:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789181270.797370:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1df1a64800 from 1 10000000:01000000:3.0:1789181270.797375:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181270.797418:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: 00000000d7297401/0x76fb555283516cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181270.797430:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: 00000000d7297401/0x76fb555283516cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181270.797442:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: 00000000d7297401/0x76fb555283516cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181270.797464:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000046a963a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408315520:0@lo:101: 00000100:00100000:3.0:1789181270.797529:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181270.797595:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e77e8bf9 going to sleep for 11 seconds 00000100:00100000:3.0:1789181270.797624:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408315520 00000100:00100000:3.0:1789181270.797633:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408315520 00000100:00100000:3.0:1789181270.797681:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789181270.797689:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e106c303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408315520:12345-0@lo:101: 00010000:00010000:3.0:1789181270.797703:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181270.797714:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a0d26e41/0x76fb555283516d02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516cfb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181270.797757:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0d26e41/0x76fb555283516d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516cfb expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181270.797769:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a0d26e41/0x76fb555283516d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516cfb expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181270.797799:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a0d26e41, rc 0) 00000100:00100000:3.0:1789181270.799082:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e106c303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408315520:12345-0@lo:101: Request processed in 1390us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181270.799092:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789181270.799408:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000046a963a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408315520:0@lo:101: 00010000:00010000:2.0:1789181270.799429:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: 00000000d7297401/0x76fb555283516cfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181270.799455:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: 00000000d7297401/0x76fb555283516cfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181270.799536:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000402087af pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408315648:0@lo:501: 00000100:00100000:2.0:1789181270.799585:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181270.799617:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000000051ff36 going to sleep for 11 seconds 00000100:00100000:3.0:1789181270.799663:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408315648 00000100:00100000:3.0:1789181270.799669:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408315648 00000100:00100000:3.0:1789181270.799776:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789181270.799785:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b53a34d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408315648:12345-0@lo:501: 00000100:00100000:3.0:1789181270.799911:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b53a34d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408315648:12345-0@lo:501: Request processed in 127us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181270.799918:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789181270.807952:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000402087af pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408315648:0@lo:501: 00000100:00100000:0.0:1789181270.808016:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006eeada79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408315776:0@lo:503: 00000100:00100000:0.0:1789181270.808090:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181270.808132:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf01248d going to sleep for 11 seconds 00000100:00100000:0.0:1789181270.808154:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408315776 00000100:00100000:0.0:1789181270.808161:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408315776 00000100:00100000:0.0:1789181270.808206:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789181270.808214:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054489f2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408315776:12345-0@lo:503: 00000100:00100000:0.0:1789181270.808380:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054489f2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408315776:12345-0@lo:503: Request processed in 167us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181270.808388:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789181270.808437:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006eeada79 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408315776:0@lo:503: 00000100:00100000:0.0:1789181270.811547:0:8232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006eeada79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8232:1876092408315904:0@lo:502: 00000100:00100000:0.0:1789181270.811621:0:8232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181270.811656:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408315904 00000100:00100000:0.0:1789181270.811663:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408315904 00000100:00100000:0.0:1789181270.811704:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789181270.811711:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000039984b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:8232:x1876092408315904:12345-0@lo:502: 00000100:00100000:0.0:1789181270.812955:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000039984b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:8232:x1876092408315904:12345-0@lo:502: Request processed in 1242us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181270.812974:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789181270.813037:0:8232:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee95cd83 going to sleep for 11 seconds 00000100:00100000:0.0:1789181270.813059:0:8232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006eeada79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8232:1876092408315904:0@lo:502: 00000020:01000000:0.0:1789181270.813088:0:8232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181270.813097:0:8232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181270.813100:0:8232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789181270.813106:0:8232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1df1a64800 00000020:00000080:0.0:1789181270.813108:0:8232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789181270.813152:0:8232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8232:1876092408316032:0@lo:502: 00000100:00100000:0.0:1789181270.813188:0:8232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181270.813215:0:8232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181270.813535:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408316032 00000100:00100000:3.0:1789181270.813552:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408316032 00000100:00100000:3.0:1789181270.813628:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789181270.813638:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:8232:x1876092408316032:12345-0@lo:502: 00000100:00100000:3.0:1789181270.813755:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:8232:x1876092408316032:12345-0@lo:502: Request processed in 118us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181270.813762:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789181270.817477:0:8232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8232:1876092408316032:0@lo:502: 00000020:01000000:0.0:1789181270.817522:0:8232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181270.817529:0:8232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181270.817531:0:8232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789181270.817535:0:8232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789181270.817630:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789181270.817652:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181270.817661:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb555283516cfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181270.817673:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb555283516cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181270.817683:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789181270.817685:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dc32aa000 from 1 10000000:01000000:0.0:1789181270.817688:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789181270.817736:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181270.817755:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181270.817765:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181270.817783:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408316160:0@lo:101: 00000100:00100000:0.0:1789181270.817906:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181270.817942:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181270.817961:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408316160 00000100:00100000:0.0:1789181270.817968:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408316160 00000100:00100000:0.0:1789181270.818007:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789181270.818016:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408316160:12345-0@lo:101: 00010000:00010000:0.0:1789181270.818029:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181270.818041:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658b600/0x76fb555283516d10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516d09 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181270.818064:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658b600/0x76fb555283516d10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516d09 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181270.818074:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658b600/0x76fb555283516d10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516d09 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181270.818084:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b600, rc 0) 00000100:00100000:0.0:1789181270.818118:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408316160:12345-0@lo:101: Request processed in 103us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181270.818125:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789181270.818165:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408316160:0@lo:101: 00010000:00010000:0.0:1789181270.818186:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181270.818195:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181270.818241:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408316288:0@lo:501: 00000100:00100000:0.0:1789181270.818264:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181270.818275:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181270.818284:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408316288 00000100:00100000:0.0:1789181270.818287:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408316288 00000100:00100000:0.0:1789181270.818922:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789181270.818932:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408316288:12345-0@lo:501: 00000100:00100000:0.0:1789181270.819046:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408316288:12345-0@lo:501: Request processed in 117us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181270.819053:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789181270.819092:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408316288:0@lo:501: 00000100:00100000:0.0:1789181270.819120:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408316416:0@lo:503: 00000100:00100000:0.0:1789181270.819158:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181270.819179:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181270.819189:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408316416 00000100:00100000:0.0:1789181270.819193:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408316416 00000100:00100000:0.0:1789181270.819215:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789181270.819221:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408316416:12345-0@lo:503: 00000100:00100000:0.0:1789181270.819294:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408316416:12345-0@lo:503: Request processed in 72us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181270.820939:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789181270.821025:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408316416:0@lo:503: 00000100:00100000:0.0:1789181270.822767:0:8233:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8233:1876092408316544:0@lo:502: 00000100:00100000:0.0:1789181270.823571:0:8233:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181270.823614:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408316544 00000100:00100000:0.0:1789181270.823622:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408316544 00000100:00100000:0.0:1789181270.823662:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789181270.823671:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:8233:x1876092408316544:12345-0@lo:502: 00000100:00100000:0.0:1789181270.824942:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:8233:x1876092408316544:12345-0@lo:502: Request processed in 1268us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181270.824953:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789181270.825021:0:8233:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181270.825043:0:8233:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8233:1876092408316544:0@lo:502: 00000020:01000000:0.0:1789181270.825079:0:8233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181270.825088:0:8233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181270.825091:0:8233:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789181270.825098:0:8233:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1dc32aa000 00000020:00000080:0.0:1789181270.825100:0:8233:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789181270.825135:0:8233:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8233:1876092408316672:0@lo:502: 00000100:00100000:0.0:1789181270.825177:0:8233:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181270.825196:0:8233:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374480 going to sleep for 11 seconds 00000100:00100000:3.0:1789181270.825279:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408316672 00000100:00100000:3.0:1789181270.825285:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408316672 00000100:00100000:3.0:1789181270.825395:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789181270.825405:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:8233:x1876092408316672:12345-0@lo:502: 00000100:00100000:3.0:1789181270.825498:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:8233:x1876092408316672:12345-0@lo:502: Request processed in 95us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181270.825506:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789181270.826558:0:8233:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8233:1876092408316672:0@lo:502: 00000020:01000000:0.0:1789181270.826589:0:8233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181270.826596:0:8233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181270.826598:0:8233:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789181270.826601:0:8233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789181270.826671:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789181270.826693:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181270.826710:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181270.826738:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181271.569380:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181272.587917:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181272.846683:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408316800:0@lo:400: 00000100:00100000:1.0:1789181272.846689:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408317184:0@lo:400: 00000100:00100000:1.0:1789181272.852957:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181272.853037:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181272.853049:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408317312:0@lo:400: 00000100:00100000:1.0:1789181272.853082:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181272.853122:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408316928:0@lo:400: 00000100:00100000:1.0:1789181272.853346:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181272.853374:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408317440:0@lo:41: 00000100:00100000:1.0:1789181272.853398:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181272.853440:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181272.853447:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408317056:0@lo:400: 00000100:00100000:1.0:1789181272.853474:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181272.853506:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408317184 00000100:00100000:1.0:1789181272.853513:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408317184 00000100:00100000:1.0:1789181272.853568:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408316928 00000100:00100000:1.0:1789181272.853571:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408316928 00000100:00100000:1.0:1789181272.853589:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181272.853598:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408317184:12345-0@lo:400: 00000100:00100000:1.0:1789181272.853654:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408317184:12345-0@lo:400: Request processed in 57us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181272.853661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181272.853677:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789181272.853683:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408316928:12345-0@lo:400: 00000100:00100000:1.0:1789181272.853714:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408316928:12345-0@lo:400: Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181272.853719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789181272.853759:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408317312 00000100:00100000:1.0:1789181272.853763:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408317312 00000100:00100000:1.0:1789181272.853780:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408317440 00000100:00100000:1.0:1789181272.853782:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408317440 00000100:00100000:1.0:1789181272.853791:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408317056 00000100:00100000:1.0:1789181272.853793:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408317056 00000100:00100000:1.0:1789181272.853805:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181272.853811:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408317312:12345-0@lo:400: 00000100:00100000:1.0:1789181272.853844:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408317312:12345-0@lo:400: Request processed in 34us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181272.853850:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181272.853860:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181272.853872:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408317440:12345-0@lo:41: 00000004:00000024:1.0:1789181272.853895:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789181272.853921:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408317440:12345-0@lo:41: Request processed in 50us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181272.853926:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181272.853936:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789181272.853940:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408317056:12345-0@lo:400: 00000100:00100000:1.0:1789181272.853965:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408317056:12345-0@lo:400: Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181272.853971:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789181272.854015:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408317056:0@lo:400: 00010000:00080000:1.0:1789181272.854027:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1dfb2abb80 x1876092408316928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181272.854037:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408316928:0@lo:400: 00000100:00100000:1.0:1789181272.854051:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408317440:0@lo:41: 00000100:00100000:1.0:1789181272.854083:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408317312:0@lo:400: 00010000:00080000:1.0:1789181272.854094:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1dfb2a8e00 x1876092408317184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181272.854102:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408317184:0@lo:400: 00000100:00100000:0.0:1789181272.854657:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181272.855544:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408316800 00000100:00100000:1.0:1789181272.855552:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408316800 00000100:00100000:1.0:1789181272.855602:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789181272.855612:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:3644:x1876092408316800:12345-0@lo:400: 00000100:00100000:1.0:1789181272.855682:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:3644:x1876092408316800:12345-0@lo:400: Request processed in 71us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181272.855699:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789181272.855830:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408316800:0@lo:400: 00010000:00010000:3.0:1789181273.618343:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181274.642174:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181275.411072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408317568:0@lo:41: 00000100:00100000:3.0:1789181275.411150:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181275.411301:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408317568 00000100:00100000:1.0:1789181275.411312:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408317568 00000100:00100000:1.0:1789181275.411363:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789181275.411372:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408317568:12345-0@lo:41: 00000004:00000024:1.0:1789181275.411408:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789181275.415347:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408317568:12345-0@lo:41: Request processed in 3966us (4187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181275.415362:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789181275.416489:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408317568:0@lo:41: 00000020:01000004:2.0:1789181275.436597:0:8429:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789181275.436602:0:8429:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789181275.436603:0:8429:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789181275.441097:0:8429:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c1dfb02c800 00000020:01000004:2.0:1789181275.441120:0:8429:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789181275.441134:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789181275.441160:0:8429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c1de7f20000) 00000020:00000080:2.0:1789181275.441178:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789181275.481552:0:8429:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789181275.482440:0:8429:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1789181275.542659:0:8429:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789181275.542927:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789181275.542939:0:8429:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789181275.542954:0:8429:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x76fb555283516d1e 00000020:01000004:1.0:1789181275.542961:0:8429:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789181275.542984:0:8429:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789181275.542987:0:8429:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789181275.542994:0:8429:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789181275.542999:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789181275.543021:0:8429:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c1e00950000) 00000020:00000080:1.0:1789181275.543036:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1789181275.546299:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181275.546511:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789181275.546518:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789181275.551405:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789181275.551425:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789181275.553236:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789181275.553249:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789181275.559700:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181275.559902:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789181275.559908:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789181275.562849:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789181275.562862:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789181275.639421:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181275.642079:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789181275.642094:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789181275.644814:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789181275.644828:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789181275.650784:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789181275.650803:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789181275.657903:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789181275.658213:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789181275.658219:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789181275.659155:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789181275.659161:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1789181275.668226:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181275.779518:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181275.780488:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789181275.780508:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789181275.789821:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789181275.789871:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789181275.793042:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789181275.793091:0:8429:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789181275.793098:0:8429:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789181275.862323:0:8429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789181275.862369:0:8429:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789181275.862374:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789181275.862376:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789181275.862377:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181275.862379:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181275.862380:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181275.862385:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181275.862387:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181275.862388:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181275.862389:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181275.862391:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181275.862392:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181275.862395:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789181275.862398:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181275.862399:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789181275.862399:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181275.862400:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181275.862401:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181275.862402:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181275.862403:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181275.862404:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181275.862405:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181275.862406:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181275.862407:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181275.862445:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789181275.863001:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408317696:0@lo:253: 00000100:00100000:2.0:1789181275.864061:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181275.864435:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408317696 00000100:00100000:0.0:1789181275.864446:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408317696 00000100:00100000:0.0:1789181275.864559:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789181275.864569:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:8429:x1876092408317696:12345-0@lo:253: 20000000:01000000:0.0:1789181275.865205:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789181275.865210:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789181275.865216:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789181275.865218:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789181275.865486:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789181275.866300:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3776180 going to sleep for 11 seconds 00000040:00080000:1.0:1789181275.869240:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789181275.869453:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789181275.869969:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789181275.869980:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789181275.869995:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789181275.870012:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789181275.870211:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789181275.870231:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:1.0:1789181275.870233:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:1.0:1789181275.870247:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789181275.870441:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789181275.870916:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789181275.870926:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:1.0:1789181275.870941:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789181275.870947:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789181275.870959:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789181275.870975:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789181275.871158:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1789181275.871172:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:1.0:1789181275.871174:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:1.0:1789181275.871189:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1789181275.871195:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789181275.871207:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1789181275.871211:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:1.0:1789181275.871223:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1789181275.871228:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789181275.871242:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1789181275.871540:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1789181275.872680:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1789181275.872701:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:0.0:1789181275.872703:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:0.0:1789181275.872717:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1789181275.872752:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789181275.872769:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1789181275.872776:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:0.0:1789181275.872787:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1789181275.872793:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789181275.872805:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1789181275.872817:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1789181275.873204:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789181275.873207:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789181275.873211:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789181275.873258:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789181275.873260:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789181275.874251:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789181275.875136:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789181275.875163:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789181275.875177:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789181275.875187:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789181275.875189:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789181275.876552:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789181275.876602:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789181275.876983:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789181275.877537:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789181275.877989:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789181275.878006:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789181275.878017:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789181275.878020:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789181275.880325:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789181275.880383:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789181275.880398:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789181275.880666:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1789181275.880690:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1789181275.880707:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1789181275.880716:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789181275.880719:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789181275.881377:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1789181275.881405:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1789181275.881418:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1789181275.881598:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1789181275.881630:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1789181275.881645:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1789181275.881662:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789181275.881683:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.881702:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1523400/0x76fb555283516bf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516bf1 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.881709:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1679200/0x76fb555283516c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516c68 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.881716:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e021f1800/0x76fb555283516ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ca0 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.881753:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658a200/0x76fb555283516cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516cbc expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.881760:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e021f1200/0x76fb555283516ced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ce6 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.881776:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.881819:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e021f1200/0x76fb555283516ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516ce6 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.881846:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1e021f1200/0x76fb555283516ced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516ce6 expref: 18 pid: 6513 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181275.881861:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408317824:0@lo:104: 00000100:00100000:1.0:1789181275.881925:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181275.881974:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658a200/0x76fb555283516cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516cbc expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.881982:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc658a200/0x76fb555283516cc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516cbc expref: 18 pid: 6516 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181275.881989:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408317952:0@lo:104: 00000100:00100000:1.0:1789181275.882011:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181275.882048:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e021f1800/0x76fb555283516ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516ca0 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.882057:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1e021f1800/0x76fb555283516ca7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516ca0 expref: 18 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181275.882066:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408318080:0@lo:104: 00000100:00100000:1.0:1789181275.882100:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181275.882116:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1679200/0x76fb555283516c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516c68 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.882131:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1679200/0x76fb555283516c6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516c68 expref: 18 pid: 6516 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181275.882140:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408318208:0@lo:104: 00000100:00100000:1.0:1789181275.882161:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181275.882177:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1523400/0x76fb555283516bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516bf1 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.882186:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1523400/0x76fb555283516bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516bf1 expref: 18 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181275.882193:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408318336:0@lo:104: 00000100:00100000:1.0:1789181275.882211:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181275.882222:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7c8b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181275.882641:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408317824 00000100:00100000:3.0:1789181275.882650:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408317824 00000100:00100000:3.0:1789181275.882687:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408317952 00000100:00100000:3.0:1789181275.882690:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408317952 00000100:00100000:3.0:1789181275.882699:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408318080 00000100:00100000:3.0:1789181275.882701:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408318080 00000100:00100000:3.0:1789181275.882709:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408318208 00000100:00100000:3.0:1789181275.882711:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408318208 00000100:00100000:3.0:1789181275.882718:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408318336 00000100:00100000:3.0:1789181275.882720:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408318336 00000100:00100000:3.0:1789181275.882754:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181275.882763:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+7:6513:x1876092408317824:12345-0@lo:104: 00010000:00010000:3.0:1789181275.882775:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0000/0x76fb555283516ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.882844:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181275.882866:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+7:6513:x1876092408317824:12345-0@lo:104: Request processed in 105us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.882874:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181275.882891:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181275.882897:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+6:6513:x1876092408317952:12345-0@lo:104: 00010000:00010000:3.0:1789181275.882904:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b400/0x76fb555283516cbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.882938:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789181275.882943:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+6:6513:x1876092408317952:12345-0@lo:104: Request processed in 47us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.882948:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181275.882959:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181275.882965:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+5:6513:x1876092408318080:12345-0@lo:104: 00010000:00010000:3.0:1789181275.882972:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1523800/0x76fb555283516ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.882998:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789181275.883002:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+5:6513:x1876092408318080:12345-0@lo:104: Request processed in 38us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.883007:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181275.883018:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181275.883023:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:6513:x1876092408318208:12345-0@lo:104: 00010000:00010000:3.0:1789181275.883029:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc658be00/0x76fb555283516c68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883054:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789181275.883065:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:6513:x1876092408318208:12345-0@lo:104: Request processed in 42us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.883070:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181275.883096:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181275.883103:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:6513:x1876092408318336:12345-0@lo:104: 00010000:00010000:3.0:1789181275.883110:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883137:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789181275.883141:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:6513:x1876092408318336:12345-0@lo:104: Request processed in 40us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.883146:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789181275.883164:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789181275.883170:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0000/0x76fb555283516ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883176:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0000 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181275.883181:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0000/0x76fb555283516ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883190:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0000/0x76fb555283516ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181275.883197:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0000/0x76fb555283516ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181275.883203:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181275.883235:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0000/0x76fb555283516ce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883251:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181275.883270:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0000/0x76fb555283516ce6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883277:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0000/0x76fb555283516ce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ced expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883292:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789181275.883294:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b400/0x76fb555283516cbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883300:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658b400 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181275.883303:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b400/0x76fb555283516cbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883310:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b400/0x76fb555283516cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181275.883316:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b400/0x76fb555283516cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181275.883321:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181275.883334:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b400/0x76fb555283516cbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883352:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181275.883358:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b400/0x76fb555283516cbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883364:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b400/0x76fb555283516cbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516cc3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883380:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789181275.883383:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1523800/0x76fb555283516ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883388:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1523800 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181275.883391:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1523800/0x76fb555283516ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883397:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1523800/0x76fb555283516ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181275.883403:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1523800/0x76fb555283516ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181275.883407:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181275.883421:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1523800/0x76fb555283516ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883426:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181275.883442:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1523800/0x76fb555283516ca0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883449:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1523800/0x76fb555283516ca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ca7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883459:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181275.883461:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658be00/0x76fb555283516c68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883477:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658be00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181275.883480:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658be00/0x76fb555283516c68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883486:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658be00/0x76fb555283516c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181275.883504:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658be00/0x76fb555283516c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181275.883509:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181275.883523:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658be00/0x76fb555283516c68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883529:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181275.883535:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658be00/0x76fb555283516c68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883541:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658be00/0x76fb555283516c68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c6f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883550:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181275.883553:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883559:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a400 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181275.883562:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883578:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181275.883584:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181275.883589:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181275.883603:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516bf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883609:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181275.883614:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516bf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883620:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516bf8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.883634:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181275.883635:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181275.883637:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181275.883660:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408318592:0@lo:103: 00000100:00100000:3.0:1789181275.883693:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.883754:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789181275.883760:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408318464:0@lo:103: 00000100:00100000:3.0:1789181275.883779:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.883800:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408318976:0@lo:103: 00000100:00100000:3.0:1789181275.883828:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.883849:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408318720:0@lo:103: 00000100:00100000:3.0:1789181275.883876:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.883896:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181275.883902:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408318848:0@lo:103: 00000100:00100000:3.0:1789181275.883923:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.883949:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408318592 00000100:00100000:3.0:1789181275.883956:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408318592 00010000:00010000:3.0:1789181275.883976:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658a200/0x76fb555283516cc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516cbc expref: 19 pid: 6516 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181275.883992:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408318464 00000100:00100000:3.0:1789181275.883994:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408318464 00010000:00010000:3.0:1789181275.884003:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e021f1200/0x76fb555283516ced lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516ce6 expref: 20 pid: 6513 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181275.884012:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408318976 00000100:00100000:3.0:1789181275.884014:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408318976 00010000:00010000:3.0:1789181275.884023:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1523400/0x76fb555283516bf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516bf1 expref: 21 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181275.884030:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408318720 00000100:00100000:3.0:1789181275.884032:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408318720 00010000:00010000:3.0:1789181275.884038:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e021f1800/0x76fb555283516ca7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516ca0 expref: 22 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181275.884045:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408318848 00000100:00100000:3.0:1789181275.884047:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408318848 00010000:00010000:3.0:1789181275.884055:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1679200/0x76fb555283516c6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516c68 expref: 23 pid: 6516 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181275.884064:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181275.884070:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+23:3644:x1876092408318592:12345-0@lo:103: 00010000:00010000:3.0:1789181275.884088:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181275.884093:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc658a200/0x76fb555283516cc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516cbc expref: 23 pid: 6516 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884103:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658a200/0x76fb555283516cc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516cbc expref: 23 pid: 6516 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884119:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181275.884150:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+23:3644:x1876092408318592:12345-0@lo:103: Request processed in 80us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.884156:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181275.884170:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181275.884176:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+22:3644:x1876092408318464:12345-0@lo:103: 00010000:00010000:3.0:1789181275.884184:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181275.884188:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e021f1200/0x76fb555283516ced lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516ce6 expref: 22 pid: 6513 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884197:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e021f1200/0x76fb555283516ced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516ce6 expref: 22 pid: 6513 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884207:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181275.884228:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+22:3644:x1876092408318464:12345-0@lo:103: Request processed in 53us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.884234:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181275.884245:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181275.884251:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+21:3644:x1876092408318976:12345-0@lo:103: 00010000:00010000:3.0:1789181275.884269:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181275.884274:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1523400/0x76fb555283516bf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516bf1 expref: 21 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884287:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1523400/0x76fb555283516bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516bf1 expref: 21 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884297:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181275.884322:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+21:3644:x1876092408318976:12345-0@lo:103: Request processed in 72us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.884329:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181275.884341:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181275.884347:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+20:3645:x1876092408318720:12345-0@lo:103: 00010000:00010000:3.0:1789181275.884354:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181275.884359:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e021f1800/0x76fb555283516ca7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516ca0 expref: 20 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884367:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e021f1800/0x76fb555283516ca7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516ca0 expref: 20 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884376:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181275.884402:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+20:3645:x1876092408318720:12345-0@lo:103: Request processed in 55us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.884408:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181275.884420:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181275.884426:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+19:3645:x1876092408318848:12345-0@lo:103: 00010000:00010000:3.0:1789181275.884433:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181275.884437:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1679200/0x76fb555283516c6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516c68 expref: 19 pid: 6516 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884446:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1679200/0x76fb555283516c6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516c68 expref: 19 pid: 6516 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884463:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884472:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884485:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884508:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884515:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884521:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884528:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181275.884532:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884539:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884548:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.884557:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181275.884582:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+19:3645:x1876092408318848:12345-0@lo:103: Request processed in 156us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.884597:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181275.884657:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408318848:0@lo:103: 00000100:00100000:3.0:1789181275.884666:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408318720:0@lo:103: 00000100:00100000:3.0:1789181275.884688:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408318464:0@lo:103: 00000100:00100000:3.0:1789181275.884694:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408318976:0@lo:103: 00000100:00100000:3.0:1789181275.884700:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408318592:0@lo:103: 00010000:00010000:3.0:1789181275.884763:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181275.885283:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f1200/0x76fb555283516ced lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516ce6 expref: 18 pid: 6513 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181275.885296:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408317824:0@lo:104: 00010000:00010000:1.0:1789181275.885305:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658a200/0x76fb555283516cc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516cbc expref: 17 pid: 6516 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181275.885313:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408317952:0@lo:104: 00010000:00010000:1.0:1789181275.885321:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f1800/0x76fb555283516ca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516ca0 expref: 16 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181275.885327:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408318080:0@lo:104: 00010000:00010000:1.0:1789181275.885335:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1679200/0x76fb555283516c6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516c68 expref: 15 pid: 6516 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181275.885361:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408318208:0@lo:104: 00010000:00010000:1.0:1789181275.885372:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523400/0x76fb555283516bf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516bf1 expref: 14 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181275.885380:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408318336:0@lo:104: 00010000:00010000:1.0:1789181275.885401:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.885410:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.885417:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.885423:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d2c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789181275.885435:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789181275.889591:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+13:8429:x1876092408317696:12345-0@lo:253: Request processed in 25013us (25522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181275.889607:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789181275.890501:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408317696:0@lo:253: 10000000:01000000:3.0:1789181275.890520:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789181275.890524:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789181275.890525:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181275.890527:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181275.890528:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789181275.890529:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181275.890530:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181275.890532:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181275.890533:0:8429:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789181275.890535:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181275.890536:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789181275.890571:0:8429:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c1dfb02c800 from lustre-OST0000 10000000:01000000:3.0:1789181275.890602:0:8429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789181275.890604:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789181275.890625:0:8429:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c1dd13ecd40 local copy 10000000:01000000:3.0:1789181275.890630:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789181275.890668:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.890678:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.890701:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181275.890719:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319104:0@lo:101: 00000100:00100000:3.0:1789181275.890806:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.890854:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181275.891025:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408319104 00000100:00100000:0.0:1789181275.891032:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408319104 00000100:00100000:0.0:1789181275.891069:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789181275.891090:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+13:8429:x1876092408319104:12345-0@lo:101: 00010000:00010000:0.0:1789181275.891102:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181275.891115:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658ba00/0x76fb555283516d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516d33 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.891137:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658ba00/0x76fb555283516d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516d33 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.891154:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658ba00/0x76fb555283516d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516d33 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.891164:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658ba00, rc 0) 00000100:00100000:0.0:1789181275.891210:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408319104:12345-0@lo:101: Request processed in 133us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181275.891216:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789181275.891530:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319104:0@lo:101: 00010000:00010000:3.0:1789181275.891551:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.891561:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181275.891665:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319232:0@lo:501: 00000100:00100000:3.0:1789181275.891700:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.891761:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181275.892324:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408319232 00000100:00100000:1.0:1789181275.892332:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408319232 00000100:00100000:1.0:1789181275.892385:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789181275.892393:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408319232:12345-0@lo:501: 00000100:00100000:1.0:1789181275.892479:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408319232:12345-0@lo:501: Request processed in 86us (777us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181275.892487:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789181275.906594:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319232:0@lo:501: 10000000:01000000:2.0:1789181275.906628:0:8429:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789181275.906678:0:8429:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789181275.906687:0:8429:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181275.906698:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181275.906705:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181275.906766:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789181275.906779:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181275.906786:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.906793:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679a00 already unused, calling callback (ffffffffc13aac20) 10000000:01000000:2.0:1789181275.906797:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c1dfb02c800 10000000:00010000:0.0:1789181275.906797:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181275.906802:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789181275.906806:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181275.906808:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789181275.906810:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:00010000:0.0:1789181275.906814:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181275.906815:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789181275.906818:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 10000000:01000000:0.0:1789181275.906820:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181275.906849:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181275.906858:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.906858:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.906864:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181275.906887:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.906906:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679a00/0x76fb555283516d33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x76fb555283516d3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.906922:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181275.906924:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181275.906926:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181275.907042:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408319488:0@lo:103: 00000100:00100000:1.0:1789181275.907119:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181275.907124:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181275.907139:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319360:0@lo:101: 00000100:00100000:2.0:1789181275.907168:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181275.907185:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3776480 going to sleep for 11 seconds 00000100:00100000:1.0:1789181275.907192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408319360 00000100:00100000:1.0:1789181275.907198:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408319360 00000100:00100000:1.0:1789181275.907245:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789181275.907263:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408319360:12345-0@lo:101: 00010000:00010000:1.0:1789181275.907276:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181275.907289:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e021f0800/0x76fb555283516d48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516d41 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.907312:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e021f0800/0x76fb555283516d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516d41 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.907322:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e021f0800/0x76fb555283516d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516d41 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.907331:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e021f0800, rc 0) 00000100:00100000:1.0:1789181275.907377:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408319360:12345-0@lo:101: Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181275.907383:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789181275.907642:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319360:0@lo:101: 00010000:00010000:2.0:1789181275.907655:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181275.907663:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181275.907742:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408319488 00000100:00100000:0.0:1789181275.907746:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408319488 00000100:00100000:2.0:1789181275.907762:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319616:0@lo:501: 00000100:00100000:0.0:1789181275.907779:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181275.907786:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+15:3644:x1876092408319488:12345-0@lo:103: 00010000:00010000:0.0:1789181275.907794:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789181275.907802:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181275.907805:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658ba00/0x76fb555283516d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283516d33 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.907815:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181275.907816:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3776480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181275.907865:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+14:3644:x1876092408319488:12345-0@lo:103: Request processed in 78us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181275.907871:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181275.909392:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408319488:0@lo:103: 00000100:00100000:3.0:1789181275.909451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408319616 00000100:00100000:3.0:1789181275.910999:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408319616 00000100:00100000:3.0:1789181275.911070:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789181275.911261:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408319616:12345-0@lo:501: 00000100:00100000:3.0:1789181275.911453:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408319616:12345-0@lo:501: Request processed in 373us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.911470:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789181275.911531:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319616:0@lo:501: 00000100:00100000:2.0:1789181275.911579:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319744:0@lo:503: 00000100:00100000:2.0:1789181275.911639:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181275.911684:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3776480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181275.911758:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408319744 00000100:00100000:0.0:1789181275.911763:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408319744 00000100:00100000:0.0:1789181275.911794:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789181275.911801:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408319744:12345-0@lo:503: 00000100:00100000:0.0:1789181275.911893:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408319744:12345-0@lo:503: Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181275.911899:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789181275.912026:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319744:0@lo:503: 00000040:00080000:2.0:1789181275.912976:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181275.913176:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319872:0@lo:502: 00000100:00100000:3.0:1789181275.913237:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.913285:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181275.913466:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408319872 00000100:00100000:1.0:1789181275.913479:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408319872 00000100:00100000:1.0:1789181275.913534:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789181275.913558:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408319872:12345-0@lo:502: 00000100:00100000:1.0:1789181275.913698:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408319872:12345-0@lo:502: Request processed in 154us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181275.913707:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789181275.914207:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408319872:0@lo:502: 00000040:00080000:3.0:1789181275.914502:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789181275.914534:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789181275.914562:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789181275.914580:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789181275.914595:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789181275.914608:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789181275.914656:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320000:0@lo:502: 00000100:00100000:3.0:1789181275.914705:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181275.914766:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408320000 00000100:00100000:3.0:1789181275.914769:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dcf567180 going to sleep for 11 seconds 00000100:00100000:0.0:1789181275.914772:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408320000 00000100:00100000:0.0:1789181275.914821:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789181275.914829:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408320000:12345-0@lo:502: 00000100:00100000:0.0:1789181275.914929:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408320000:12345-0@lo:502: Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181275.914936:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789181275.916043:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320000:0@lo:502: 00000040:00080000:3.0:1789181275.916239:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789181275.916263:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789181275.918218:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789181275.918245:0:8452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789181275.918258:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181275.918261:0:8452:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789181275.918267:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789181275.918285:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c1e00953380) 00000020:00000080:1.0:1789181275.918309:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789181275.918316:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789181275.918412:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1dfb02c800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789181275.918422:0:8452:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789181275.918429:0:8452:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x76fb555283516d56 00010000:00010000:0.0:1789181275.922184:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1789181275.929370:0:8452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789181275.937635:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789181275.938169:0:8452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789181275.946552:0:8452:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789181275.946769:0:8452:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789181275.951996:0:8452:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789181275.953681:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789181275.953694:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181275.953700:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181275.953702:0:8452:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789181275.953706:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181275.953711:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181275.953712:0:8452:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789181275.953715:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789181275.953717:0:8452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789181275.953766:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181275.953771:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181275.953772:0:8452:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789181275.953776:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789181275.956143:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789181275.956185:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789181275.956204:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.956218:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181275.956245:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dfb02c800 from 1 10000000:01000000:3.0:1789181275.956260:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181275.956299:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.956308:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.956319:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181275.956351:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320128:0@lo:101: 00000100:00100000:3.0:1789181275.956420:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.956462:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181275.956962:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408320128 00000100:00100000:1.0:1789181275.956970:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408320128 00000100:00100000:1.0:1789181275.957011:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789181275.957020:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+14:8429:x1876092408320128:12345-0@lo:101: 00010000:00010000:1.0:1789181275.957033:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181275.957046:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516d5d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.957071:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516d5d expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.957083:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516d5d expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181275.957092:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e021f0200, rc 0) 00000100:00100000:1.0:1789181275.957135:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408320128:12345-0@lo:101: Request processed in 116us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181275.957142:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789181275.957246:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320128:0@lo:101: 00010000:00010000:3.0:1789181275.957328:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.957337:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181275.957423:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320256:0@lo:501: 00000100:00100000:3.0:1789181275.957458:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.957498:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181275.957550:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408320256 00000100:00100000:1.0:1789181275.957555:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408320256 00000100:00100000:1.0:1789181275.957587:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789181275.957594:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408320256:12345-0@lo:501: 00000100:00100000:1.0:1789181275.957680:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408320256:12345-0@lo:501: Request processed in 86us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181275.957686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789181275.958020:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320256:0@lo:501: 00000100:00100000:3.0:1789181275.958047:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320384:0@lo:503: 00000100:00100000:3.0:1789181275.958087:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.958117:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181275.958169:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408320384 00000100:00100000:2.0:1789181275.958174:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408320384 00000100:00100000:2.0:1789181275.958200:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789181275.958207:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408320384:12345-0@lo:503: 00000100:00100000:2.0:1789181275.958359:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408320384:12345-0@lo:503: Request processed in 152us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181275.958366:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789181275.959483:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320384:0@lo:503: 00000040:00080000:3.0:1789181275.959793:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181275.959886:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320512:0@lo:502: 00000100:00100000:3.0:1789181275.959944:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.959979:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de19bac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181275.960056:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408320512 00000100:00100000:2.0:1789181275.960062:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408320512 00000100:00100000:2.0:1789181275.960106:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789181275.960115:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408320512:12345-0@lo:502: 00000100:00100000:2.0:1789181275.960212:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408320512:12345-0@lo:502: Request processed in 98us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181275.960219:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789181275.960473:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320512:0@lo:502: 00000040:00080000:0.0:1789181275.960669:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789181275.960698:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789181275.960748:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320640:0@lo:502: 00000100:00100000:0.0:1789181275.960795:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181275.960823:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181275.960965:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408320640 00000100:00100000:2.0:1789181275.960971:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408320640 00000100:00100000:2.0:1789181275.961005:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789181275.961019:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408320640:12345-0@lo:502: 00000100:00100000:2.0:1789181275.961093:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408320640:12345-0@lo:502: Request processed in 74us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181275.961099:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789181275.961203:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320640:0@lo:502: 00000040:00080000:0.0:1789181275.961259:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789181275.961268:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789181275.964409:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181275.964422:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181275.964425:0:8456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789181275.964432:0:8456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1dfb02c800 00000020:00000080:2.0:1789181275.964435:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789181275.964449:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181275.964452:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181275.964453:0:8456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789181275.964456:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789181275.964663:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789181275.964691:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181275.964713:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.964755:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181275.964802:0:8429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789181275.964805:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c1dfb02c800 10000000:01000000:0.0:1789181275.964808:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c1dfb02c800 10000000:01000000:0.0:1789181275.964812:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789181275.964818:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1dfb02c800 from 1 10000000:01000000:0.0:1789181275.964821:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181275.964854:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.964970:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.964982:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181275.965006:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320768:0@lo:101: 00000100:00100000:0.0:1789181275.965079:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181275.965118:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789181275.965172:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408320768 00000100:00100000:3.0:1789181275.965179:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408320768 00000100:00100000:3.0:1789181275.965219:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789181275.965240:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:8429:x1876092408320768:12345-0@lo:101: 00010000:00010000:3.0:1789181275.965264:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181275.965276:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1679600/0x76fb555283516d72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516d6b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.965299:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1679600/0x76fb555283516d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516d6b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.965309:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1679600/0x76fb555283516d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516d6b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181275.965318:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679600, rc 0) 00000100:00100000:3.0:1789181275.965364:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:8429:x1876092408320768:12345-0@lo:101: Request processed in 126us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.965370:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789181275.965507:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320768:0@lo:101: 00010000:00010000:0.0:1789181275.965520:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181275.965535:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181275.965609:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320896:0@lo:501: 00000100:00100000:0.0:1789181275.965660:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181275.965674:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789181275.965830:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408320896 00000100:00100000:3.0:1789181275.965834:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408320896 00000100:00100000:3.0:1789181275.965869:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789181275.965877:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:8429:x1876092408320896:12345-0@lo:501: 00000100:00100000:3.0:1789181275.965970:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:8429:x1876092408320896:12345-0@lo:501: Request processed in 93us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.965977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789181275.966136:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408320896:0@lo:501: 00000100:00100000:0.0:1789181275.966163:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408321024:0@lo:503: 00000100:00100000:0.0:1789181275.966203:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181275.966221:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181275.966353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408321024 00000100:00100000:2.0:1789181275.966358:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408321024 00000100:00100000:2.0:1789181275.966392:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789181275.966399:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:8429:x1876092408321024:12345-0@lo:503: 00000100:00100000:2.0:1789181275.966476:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:8429:x1876092408321024:12345-0@lo:503: Request processed in 77us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181275.966482:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789181275.966606:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408321024:0@lo:503: 00000040:00080000:0.0:1789181275.966931:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789181275.966991:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408321152:0@lo:502: 00000100:00100000:0.0:1789181275.967033:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181275.967057:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181275.968384:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408321152 00000100:00100000:2.0:1789181275.968396:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408321152 00000100:00100000:2.0:1789181275.968452:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789181275.968461:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:8429:x1876092408321152:12345-0@lo:502: 00000100:00100000:2.0:1789181275.968596:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:8429:x1876092408321152:12345-0@lo:502: Request processed in 136us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181275.968603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789181275.969419:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408321152:0@lo:502: 00000040:00080000:0.0:1789181275.969664:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789181275.969695:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789181275.969711:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789181275.969761:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789181275.969778:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789181275.969793:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789181275.969807:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789181275.969819:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789181275.969833:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789181275.969848:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789181275.971351:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789181275.971374:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789181275.971388:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789181275.971401:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789181275.971414:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789181275.971438:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789181275.971453:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789181275.971468:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789181275.971544:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789181275.971562:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789181275.971577:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789181275.971591:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789181275.971603:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789181275.971617:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789181275.971631:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789181275.971643:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789181275.971655:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789181275.971668:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789181275.971682:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789181275.971696:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789181275.971708:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789181275.971742:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789181275.971760:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789181275.971774:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789181275.971801:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789181275.971816:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789181275.971830:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1789181275.972544:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408321280:0@lo:502: 00000100:00100000:0.0:1789181275.972627:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181275.972662:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789181275.972970:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408321280 00000100:00100000:3.0:1789181275.972979:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408321280 00000100:00100000:3.0:1789181275.973027:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789181275.973037:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:8429:x1876092408321280:12345-0@lo:502: 00000100:00100000:3.0:1789181275.973161:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:8429:x1876092408321280:12345-0@lo:502: Request processed in 125us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.973177:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789181275.973418:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408321280:0@lo:502: 00000040:00080000:0.0:1789181275.973506:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789181275.973516:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789181275.974369:0:8457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789181275.974386:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c1de7f23380) 00000020:00000080:2.0:1789181275.974416:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789181275.974538:0:8457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1dfb02c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789181275.974543:0:8457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1dfb02c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789181275.974546:0:8457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1dfb02c800 3 00010000:00080000:2.0:1789181275.974575:0:8457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1cc2474800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1789181275.978626:0:8457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789181275.979071:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789181275.979120:0:8457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789181275.979133:0:8457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x76fb555283516d80 00000100:00080000:3.0:1789181275.979142:0:8457:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789181275.979154:0:8457:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c1cc2474800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181275.979188:0:8457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc4302a00 x1876092408321408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181275.979260:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876092408321408:0@lo:38: 00000100:00100000:1.0:1789181275.979324:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789181275.979433:0:8457:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789181275.979543:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408321536:0@lo:400: 00000100:00100000:3.0:1789181275.979572:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.979594:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181275.979599:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408321664:0@lo:400: 00000100:00100000:3.0:1789181275.979619:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.979649:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408321792:0@lo:400: 00000100:00100000:3.0:1789181275.979674:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181275.979709:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408321408 00000100:00100000:3.0:1789181275.979717:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408321408 00000100:00100000:3.0:1789181275.979758:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408321536 00000100:00100000:3.0:1789181275.979761:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408321536 00000100:00100000:3.0:1789181275.979779:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408321664 00000100:00100000:3.0:1789181275.979782:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408321664 00000100:00100000:3.0:1789181275.979812:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181275.979820:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408321536:12345-0@lo:400: 00000100:00100000:3.0:1789181275.980094:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408321536:12345-0@lo:400: Request processed in 274us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.980109:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181275.980126:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181275.980132:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408321664:12345-0@lo:400: 00000100:00100000:3.0:1789181275.980161:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408321664:12345-0@lo:400: Request processed in 30us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.980166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181275.980179:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181275.980183:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876092408321408:12345-0@lo:38: 00010000:00080000:3.0:1789181275.980202:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1789181275.980229:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x76fb555283516d87 00000004:00100000:3.0:1789181275.980242:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789181275.981626:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9c1de7e67800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181275.991737:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876092408321408:12345-0@lo:38: Request processed in 11528us (12389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.991754:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181275.991808:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408321792 00000100:00100000:3.0:1789181275.991820:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408321792 00000100:00100000:3.0:1789181275.991866:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181275.991875:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408321792:12345-0@lo:400: 00000100:00100000:3.0:1789181275.991957:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408321792:12345-0@lo:400: Request processed in 82us (12281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181275.991964:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181275.992011:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408321792:0@lo:400: 00010000:00080000:3.0:1789181275.992049:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1dc4303800 x1876092408321664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181275.992075:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408321664:0@lo:400: 00010000:00080000:3.0:1789181275.992090:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1dc4301180 x1876092408321536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181275.992098:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408321536:0@lo:400: 00000020:01000004:3.0:1789181275.992349:0:8457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789181275.992363:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c1dc4e00000) 00000020:00000080:3.0:1789181275.992385:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1789181275.992476:0:8457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1dfb02c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789181275.992480:0:8457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1dfb02c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789181275.992483:0:8457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1dfb02c800 3 00010000:00080000:3.0:1789181275.992520:0:8457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1e00b92000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00080000:1.0:1789181275.997198:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1dc4302a00 x1876092408321408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181275.997213:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789181275.997223:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789181275.997231:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789181275.997235:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789181275.997238:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc2474800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789181275.997245:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876092408321408:0@lo:38: 00010000:00010000:3.0:1789181275.997718:0:8457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1789181275.997974:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789181275.998016:0:8457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789181275.998031:0:8457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x76fb555283516d95 00000100:00080000:3.0:1789181275.998038:0:8457:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789181275.998049:0:8457:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c1e00b92000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181275.998079:0:8457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc4301180 x1876092408321920/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789181275.998101:0:8457:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789181276.000970:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876092408321920:0@lo:38: 00000100:00100000:1.0:1789181276.001063:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181276.001886:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408321920 00000100:00100000:3.0:1789181276.001896:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408321920 00000100:00100000:3.0:1789181276.001934:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181276.001942:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876092408321920:12345-0@lo:38: 00010000:00080000:3.0:1789181276.001969:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1789181276.002012:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x76fb555283516d9c 00000004:00100000:3.0:1789181276.002027:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789181276.002058:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf40000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181276.002123:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876092408321920:12345-0@lo:38: Request processed in 180us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181276.002130:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789181276.002181:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1dc4301180 x1876092408321920/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181276.002192:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181276.002199:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789181276.002206:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789181276.002210:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789181276.002212:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1e00b92000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789181276.002217:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876092408321920:0@lo:38: 00000040:00080000:3.0:1789181276.003184:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789181276.004952:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789181276.004994:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181276.005015:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.005028:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789181276.005081:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789181276.005083:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789181276.005084:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181276.005085:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181276.005086:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181276.005088:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181276.005089:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181276.005091:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181276.005092:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181276.005094:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181276.005095:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181276.005099:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789181276.005101:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181276.005103:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789181276.005104:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181276.005105:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181276.005106:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181276.005107:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181276.005108:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181276.005109:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181276.005110:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181276.005111:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181276.005112:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181276.005141:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789181276.005159:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408322048:0@lo:253: 00000100:00100000:2.0:1789181276.005227:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181276.005436:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dcf606780 going to sleep for 11 seconds 00000100:00100000:2.0:1789181276.006995:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408322048 00000100:00100000:2.0:1789181276.007007:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408322048 00000100:00100000:2.0:1789181276.007061:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789181276.007071:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:8429:x1876092408322048:12345-0@lo:253: 20000000:01000000:2.0:1789181276.007101:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789181276.007114:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789181276.041629:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789181276.041655:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789181276.041856:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789181276.041862:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789181276.041886:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.041907:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658aa00/0x76fb555283516c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516c92 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.041915:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658a600/0x76fb555283516cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516cae expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.041922:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.041965:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658a600/0x76fb555283516cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516cae expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.041980:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc658a600/0x76fb555283516cb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516cae expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181276.041995:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408322176:0@lo:104: 00000100:00100000:2.0:1789181276.042073:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181276.042124:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658aa00/0x76fb555283516c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516c92 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.042133:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc658aa00/0x76fb555283516c99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516c92 expref: 16 pid: 6516 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181276.042142:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408322304:0@lo:104: 00000100:00100000:2.0:1789181276.042161:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dcf606180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181276.042168:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789181276.042194:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181276.042223:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408322176 00000100:00100000:3.0:1789181276.042230:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408322176 00000100:00100000:3.0:1789181276.042293:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408322304 00000100:00100000:3.0:1789181276.042304:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408322304 00000100:00100000:3.0:1789181276.042320:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789181276.042336:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb192c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:6537:x1876092408322176:12345-0@lo:104: 00010000:00010000:3.0:1789181276.042348:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0400/0x76fb555283516cae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042431:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181276.042451:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb192c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:6537:x1876092408322176:12345-0@lo:104: Request processed in 117us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181276.042468:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789181276.042469:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408322176:0@lo:104: 00000100:00100000:3.0:1789181276.042527:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181276.042533:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:6537:x1876092408322304:12345-0@lo:104: 00010000:00010000:3.0:1789181276.042541:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042639:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789181276.042645:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:6537:x1876092408322304:12345-0@lo:104: Request processed in 112us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181276.042651:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789181276.042677:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181276.042683:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0400/0x76fb555283516cae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042696:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0400 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181276.042700:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0400/0x76fb555283516cae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042708:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0400/0x76fb555283516cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181276.042715:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0400/0x76fb555283516cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181276.042742:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789181276.042768:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408322304:0@lo:104: 00010000:00010000:3.0:1789181276.042777:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0400/0x76fb555283516cae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.042785:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042799:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181276.042832:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0400/0x76fb555283516cae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042839:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0400/0x76fb555283516cae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516cb5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042867:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181276.042870:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042882:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678a00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181276.042884:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042890:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181276.042897:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181276.042902:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181276.042923:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516c92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042929:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181276.042950:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516c92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.042957:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516c92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516c99 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181276.042968:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408322432:0@lo:103: 00010000:00010000:3.0:1789181276.042984:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181276.042986:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181276.042987:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181276.042996:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181276.043001:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181276.043214:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408322560:0@lo:103: 00000100:00100000:3.0:1789181276.043254:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181276.043304:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408322432 00000100:00100000:3.0:1789181276.043317:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408322432 00010000:00010000:3.0:1789181276.043333:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658a600/0x76fb555283516cb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516cae expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181276.043360:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408322560 00000100:00100000:3.0:1789181276.043370:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408322560 00010000:00010000:3.0:1789181276.043382:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658aa00/0x76fb555283516c99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516c92 expref: 18 pid: 6516 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181276.043410:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789181276.043415:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181276.043417:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da575344-f445-48a7-8532-0e6efd2ea878+18:3644:x1876092408322432:12345-0@lo:103: 00000100:00100000:2.0:1789181276.043421:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+18:3645:x1876092408322560:12345-0@lo:103: 00010000:00010000:2.0:1789181276.043429:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181276.043432:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181276.043436:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc658a600/0x76fb555283516cb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516cae expref: 18 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.043436:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc658aa00/0x76fb555283516c99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516c92 expref: 18 pid: 6516 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.043446:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658aa00/0x76fb555283516c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516c92 expref: 18 pid: 6516 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181276.043585:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:8429:x1876092408322048:12345-0@lo:253: Request processed in 36514us (38357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181276.043593:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:3.0:1789181276.047580:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658a600/0x76fb555283516cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516cae expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.047630:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658a600/0x76fb555283516cb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516cae expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181276.047648:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181276.047909:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da575344-f445-48a7-8532-0e6efd2ea878+16:3644:x1876092408322432:12345-0@lo:103: Request processed in 4490us (4909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181276.047919:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181276.048415:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408322432:0@lo:103: 00010000:00010000:2.0:1789181276.051629:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658aa00/0x76fb555283516c99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516c92 expref: 15 pid: 6516 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.051674:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.051684:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789181276.051706:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012487745s 00010000:00010000:2.0:1789181276.051712:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.051719:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.051753:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.051760:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.051768:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1523800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181276.051772:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.051781:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.051802:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181276.051815:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181276.051912:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+14:3645:x1876092408322560:12345-0@lo:103: Request processed in 8489us (8662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181276.051921:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789181276.052035:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:8429:1876092408322048:0@lo:253: 10000000:01000000:2.0:1789181276.052049:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789181276.052053:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789181276.052054:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789181276.052056:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181276.052057:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181276.052058:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181276.052060:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181276.052061:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181276.052063:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181276.052065:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181276.052066:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181276.052067:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789181276.052082:0:8429:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789181276.052667:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181276.052679:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181276.052686:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523800/0x76fb555283516da3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181276.052806:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408322560:0@lo:103: 00080000:10000000:3.0:1789181276.065379:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789181276.065687:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789181276.066000:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789181276.066244:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789181276.066565:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789181276.066934:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789181276.071699:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789181276.084509:0:8429:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789181276.084519:0:8429:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789181276.084558:0:8429:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789181276.084605:0:8429:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789181276.084628:0:8429:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789181276.084647:0:8429:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789181276.085559:0:8429:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789181276.085770:0:8429:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789181276.684385:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789181277.453145:0:8514:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789181277.453336:0:8514:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789181277.713617:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181277.964014:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181277.964039:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408322688:0@lo:41: 00000100:00100000:1.0:1789181277.964116:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181277.964388:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408322688 00000100:00100000:2.0:1789181277.964396:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408322688 00000100:00100000:2.0:1789181277.964451:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789181277.964460:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408322688:12345-0@lo:41: 00000004:00000024:2.0:1789181277.964530:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789181277.964584:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408322688:12345-0@lo:41: Request processed in 124us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181277.964591:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789181277.964865:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408322688:0@lo:41: 00010000:00010000:3.0:1789181278.747717:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789181279.308866:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789181279.308874:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1df1a64800 from 30 10000000:01000000:3.0:1789181279.308879:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789181279.308924:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181279.308937:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181279.308950:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181279.308973:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408322816:0@lo:101: 00000100:00100000:3.0:1789181279.309045:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181279.309111:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb3403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.309319:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408322816 00000100:00100000:2.0:1789181279.309481:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408322816 00000100:00100000:2.0:1789181279.309541:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789181279.309551:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+14:6518:x1876092408322816:12345-0@lo:101: 00010000:00010000:2.0:1789181279.309566:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181279.309579:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516daa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.309679:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516daa expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.309691:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516daa expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.309701:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522a00, rc 0) 00000100:00100000:2.0:1789181279.309952:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408322816:12345-0@lo:101: Request processed in 401us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.309958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789181279.314538:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408322816:0@lo:101: 00010000:00010000:1.0:1789181279.314800:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181279.314816:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181279.314916:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408322944:0@lo:501: 00000100:00100000:1.0:1789181279.314985:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.316710:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd37763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181279.318266:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408322944 00000100:00100000:3.0:1789181279.318290:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408322944 00000100:00100000:3.0:1789181279.318540:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789181279.318552:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408322944:12345-0@lo:501: 00000100:00100000:3.0:1789181279.318779:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408322944:12345-0@lo:501: Request processed in 229us (3793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.318788:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789181279.318888:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408322944:0@lo:501: 00000100:00100000:1.0:1789181279.318941:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323072:0@lo:503: 00000100:00100000:1.0:1789181279.318992:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.322278:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd37763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181279.325335:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408323072 00000100:00100000:0.0:1789181279.325350:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408323072 00000100:00100000:0.0:1789181279.325552:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789181279.325564:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408323072:12345-0@lo:503: 00000100:00100000:0.0:1789181279.325757:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408323072:12345-0@lo:503: Request processed in 195us (6763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181279.325764:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789181279.325967:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323072:0@lo:503: 00000100:00100000:1.0:1789181279.326507:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8611:1876092408323200:0@lo:502: 00000100:00100000:1.0:1789181279.326557:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.326595:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3776300 going to sleep for 11 seconds 00000100:00100000:0.0:1789181279.326638:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408323200 00000100:00100000:0.0:1789181279.326643:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408323200 00000100:00100000:0.0:1789181279.326668:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789181279.326682:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:8611:x1876092408323200:12345-0@lo:502: 00000100:00100000:0.0:1789181279.326801:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:8611:x1876092408323200:12345-0@lo:502: Request processed in 120us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181279.326808:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789181279.326885:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8611:1876092408323200:0@lo:502: 00000100:00100000:1.0:1789181279.326925:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8611:1876092408323328:0@lo:502: 00000100:00100000:1.0:1789181279.326957:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.326977:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3776300 going to sleep for 11 seconds 00000100:00100000:0.0:1789181279.327013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408323328 00000100:00100000:0.0:1789181279.327018:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408323328 00000100:00100000:0.0:1789181279.327037:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789181279.327042:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:8611:x1876092408323328:12345-0@lo:502: 00000100:00100000:0.0:1789181279.327204:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:8611:x1876092408323328:12345-0@lo:502: Request processed in 161us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181279.327210:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789181279.327680:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8611:1876092408323328:0@lo:502: 00000040:00080000:1.0:1789181279.327702:0:8611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789181279.327993:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789181279.328017:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789181279.328028:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181279.328039:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181279.328049:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789181279.328051:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1df1a64800 from 5 10000000:01000000:0.0:1789181279.328054:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789181279.328153:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181279.328162:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181279.328171:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181279.328193:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323456:0@lo:101: 00000100:00100000:0.0:1789181279.328237:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181279.328304:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.328455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408323456 00000100:00100000:2.0:1789181279.328470:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408323456 00000100:00100000:2.0:1789181279.328551:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789181279.328559:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408323456:12345-0@lo:101: 00010000:00010000:2.0:1789181279.328570:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181279.328584:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523600/0x76fb555283516dbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516db8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.328606:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523600/0x76fb555283516dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516db8 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.328616:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523600/0x76fb555283516dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516db8 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.328638:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523600, rc 0) 00000100:00100000:2.0:1789181279.328716:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408323456:12345-0@lo:101: Request processed in 157us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.328752:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789181279.328944:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323456:0@lo:101: 00010000:00010000:0.0:1789181279.328958:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181279.328966:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181279.329011:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323584:0@lo:256: 00000100:00100000:0.0:1789181279.329040:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181279.329162:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.329216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408323584 00000100:00100000:2.0:1789181279.329221:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408323584 00000100:00100000:2.0:1789181279.329252:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789181279.329258:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408323584:12345-0@lo:256: 20000000:01000000:2.0:1789181279.329271:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789181279.329287:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789181279.329290:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789181279.329676:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408323584:12345-0@lo:256: Request processed in 416us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.329684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789181279.329910:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323584:0@lo:256: 10000000:01000000:1.0:1789181279.329972:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789181279.329979:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181279.329987:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181279.329995:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789181279.329998:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789181279.330000:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789181279.330020:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181279.330028:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181279.330036:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181279.330050:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323712:0@lo:101: 00000100:00100000:1.0:1789181279.330078:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.330204:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3776300 going to sleep for 11 seconds 00000100:00100000:0.0:1789181279.330235:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408323712 00000100:00100000:0.0:1789181279.330239:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408323712 00000100:00100000:0.0:1789181279.330300:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789181279.330308:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408323712:12345-0@lo:101: 00010000:00010000:0.0:1789181279.330317:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181279.330441:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658b400/0x76fb555283516dcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516dc6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181279.330467:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658b400/0x76fb555283516dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516dc6 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181279.330477:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658b400/0x76fb555283516dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516dc6 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181279.330494:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b400, rc 0) 00000100:00100000:0.0:1789181279.330530:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408323712:12345-0@lo:101: Request processed in 224us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181279.330536:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789181279.330593:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323712:0@lo:101: 00010000:00010000:1.0:1789181279.330604:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181279.330613:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181279.330675:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323840:0@lo:501: 00000100:00100000:1.0:1789181279.330700:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.330894:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3776300 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.330971:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408323840 00000100:00100000:2.0:1789181279.330975:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408323840 00000100:00100000:2.0:1789181279.330997:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789181279.331004:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408323840:12345-0@lo:501: 00000100:00100000:2.0:1789181279.331199:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408323840:12345-0@lo:501: Request processed in 195us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.331206:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789181279.331263:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323840:0@lo:501: 00000100:00100000:1.0:1789181279.331290:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323968:0@lo:503: 00000100:00100000:1.0:1789181279.331328:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.331349:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3776300 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.331511:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408323968 00000100:00100000:2.0:1789181279.331515:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408323968 00000100:00100000:2.0:1789181279.331532:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789181279.331537:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408323968:12345-0@lo:503: 00000100:00100000:2.0:1789181279.331623:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408323968:12345-0@lo:503: Request processed in 84us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.331635:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789181279.331714:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408323968:0@lo:503: 00000100:00100000:1.0:1789181279.332061:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8612:1876092408324096:0@lo:502: 00000100:00100000:1.0:1789181279.332112:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.332141:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3776b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.332232:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408324096 00000100:00100000:2.0:1789181279.332236:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408324096 00000100:00100000:2.0:1789181279.332255:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789181279.332260:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:8612:x1876092408324096:12345-0@lo:502: 00000100:00100000:2.0:1789181279.332354:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:8612:x1876092408324096:12345-0@lo:502: Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.332360:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789181279.332557:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8612:1876092408324096:0@lo:502: 00000020:01000000:1.0:1789181279.332577:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789181279.332585:0:8612:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789181279.332592:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181279.332595:0:8612:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789181279.332604:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789181279.332607:0:8612:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:1.0:1789181279.332630:0:8612:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789181279.332635:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789181279.332653:0:8612:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c1e009519c0) 00000020:00000080:1.0:1789181279.332677:0:8612:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1789181279.332683:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789181279.332802:0:8612:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789181279.332809:0:8612:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789181279.332822:0:8612:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb555283516ddb 00010000:00080000:1.0:1789181279.332859:0:8612:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1e00920800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1789181279.333077:0:8612:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789181279.352946:0:8612:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789181279.352975:0:8612:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789181279.353490:0:8612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181279.355805:0:8612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181279.365855:0:8612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789181279.366082:0:8612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789181279.374908:0:8615:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181279.374921:0:8615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789181279.380789:0:8612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789181279.380806:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789181279.380866:0:8612:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789181279.380892:0:8612:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb555283516de2 00000100:00080000:0.0:1789181279.380902:0:8612:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789181279.380914:0:8612:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c1e00920800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181279.380953:0:8612:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dd136ca80 x1876092408324224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181279.380980:0:8612:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789181279.381103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408324352:0@lo:400: 00000100:00100000:0.0:1789181279.381162:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181279.381202:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408324864:0@lo:400: 00000100:00100000:0.0:1789181279.381238:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181279.381276:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789181279.381283:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408324480:0@lo:400: 00000100:00100000:2.0:1789181279.381310:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408324352 00000100:00100000:2.0:1789181279.381318:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408324352 00000100:00100000:2.0:1789181279.381358:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408324864 00000100:00100000:2.0:1789181279.381449:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408324864 00000100:00100000:2.0:1789181279.381549:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789181279.381560:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408324352:12345-0@lo:400: 00000100:00100000:3.0:1789181279.381662:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408324224:0@lo:8: 00000100:00100000:1.0:1789181279.382032:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408324608:0@lo:400: 00000100:00100000:2.0:1789181279.382184:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408324352:12345-0@lo:400: Request processed in 625us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.382193:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789181279.382214:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789181279.382294:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408324864:12345-0@lo:400: 00000100:00100000:3.0:1789181279.383033:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.383044:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408324864:12345-0@lo:400: Request processed in 823us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.383052:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789181279.383080:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181279.383169:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408324224 00000100:00100000:3.0:1789181279.383175:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408324224 00000100:00100000:3.0:1789181279.383201:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181279.383207:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408324224:12345-0@lo:8: 00010000:00080000:3.0:1789181279.383233:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:3.0:1789181279.383281:0:8435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb555283516de9 00000100:00100000:1.0:1789181279.383499:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:3.0:1789181279.383522:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c1e00b95800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789181279.383527:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1789181279.383531:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789181279.383532:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181279.383540:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408324736:0@lo:400: 00000100:00100000:1.0:1789181279.383565:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:3.0:1789181279.383591:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789181279.383896:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789181279.383922:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c1e00b96800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181279.383967:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876092408324224:12345-0@lo:8: Request processed in 758us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.383979:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181279.384003:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408324736 00000100:00100000:2.0:1789181279.384004:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408324608 00000100:00100000:3.0:1789181279.384006:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408324736 00000100:00100000:2.0:1789181279.384007:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408324608 00000100:00100000:3.0:1789181279.384033:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181279.384040:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408324736:12345-0@lo:400: 00000100:00100000:3.0:1789181279.384080:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408324736:12345-0@lo:400: Request processed in 41us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.384086:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181279.384119:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408324736:0@lo:400: 00000020:01000000:1.0:1789181279.384119:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181279.384125:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181279.384127:0:8612:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789181279.384130:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181279.384134:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181279.384135:0:8612:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789181279.384139:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789181279.384140:0:8612:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00010000:00080000:3.0:1789181279.384146:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dd136ca80 x1876092408324224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181279.384155:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181279.384160:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00100000:1.0:1789181279.384166:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8612:1876092408325120:0@lo:502: 00000100:00080000:3.0:1789181279.384167:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789181279.384172:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789181279.384175:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1e00920800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789181279.384184:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789181279.384188:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408324224:0@lo:8: 00000004:00080000:3.0:1789181279.384206:0:8615:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789181279.384207:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.384386:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789181279.384395:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408324608:12345-0@lo:400: 00000100:00100000:2.0:1789181279.384439:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408324608:12345-0@lo:400: Request processed in 46us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.384445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789181279.384491:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181279.384516:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408324992:0@lo:400: 00000100:00100000:0.0:1789181279.384543:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789181279.384608:0:8615:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 235371883881ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789181279.384627:0:8615:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789181279.387020:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408324992 00000100:00100000:3.0:1789181279.387034:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408324992 00010000:00080000:0.0:1789181279.387055:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dd136e680 x1876092408324352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181279.387082:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408324352:0@lo:400: 00010000:00080000:0.0:1789181279.387098:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dd136e300 x1876092408324864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181279.387102:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789181279.387107:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408324864:0@lo:400: 00000100:00100000:3.0:1789181279.387111:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408324992:12345-0@lo:400: 00000100:00100000:3.0:1789181279.387179:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408324992:12345-0@lo:400: Request processed in 69us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.387186:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789181279.387189:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408324480 00000100:00100000:0.0:1789181279.387192:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408324480 00000100:00100000:0.0:1789181279.387214:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181279.387289:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408324480:12345-0@lo:400: 00000100:00100000:0.0:1789181279.387442:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408324480:12345-0@lo:400: Request processed in 221us (2950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181279.387448:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789181279.387578:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789181279.387605:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dd136c380 x1876092408324608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181279.387614:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408324608:0@lo:400: 00000100:00100000:1.0:1789181279.387784:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f82cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181279.387830:0:8616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8616:1876092408325248:0@lo:700: 00000100:00100000:1.0:1789181279.387936:0:8616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.387951:0:8616:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181279.388041:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408325248 00000100:00100000:3.0:1789181279.388046:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408325248 00000100:00100000:3.0:1789181279.388252:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181279.388261:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8616:x1876092408325248:12345-0@lo:700: 00000100:00100000:3.0:1789181279.388365:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4302a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1876092408325376:0@lo:700: 00000100:00100000:3.0:1789181279.388404:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181279.388425:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb340d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181279.388441:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408325376 00000100:00100000:3.0:1789181279.388445:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408325376 00000100:00100000:3.0:1789181279.388484:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181279.388491:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1876092408325376:12345-0@lo:700: 00000100:00080000:2.0:1789181279.389075:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789181279.389175:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789181279.389176:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408325120 00000100:00100000:3.0:1789181279.389182:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408325120 00000100:00100000:3.0:1789181279.389212:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789181279.389221:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:8612:x1876092408325120:12345-0@lo:502: 00000100:00100000:0.0:1789181279.389307:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408324480:0@lo:400: 00010000:00080000:0.0:1789181279.389322:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dd136f480 x1876092408324992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181279.389333:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408324992:0@lo:400: 00000100:00100000:3.0:1789181279.390756:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:8612:x1876092408325120:12345-0@lo:502: Request processed in 1499us (6511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.390772:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789181279.391041:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8612:1876092408325120:0@lo:502: 00000020:01000000:1.0:1789181279.391080:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181279.391101:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181279.391109:0:8612:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789181279.391114:0:8612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1789181279.391398:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1789181279.391421:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789181279.391433:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.391446:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181279.391456:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789181279.391488:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1dc32aa000 from 30 10000000:01000000:2.0:1789181279.391491:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789181279.391526:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.391535:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.391545:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181279.391563:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408325504:0@lo:101: 00000100:00100000:2.0:1789181279.391612:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.391656:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181279.391712:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408325504 00000100:00100000:3.0:1789181279.391719:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408325504 00000100:00100000:3.0:1789181279.391794:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789181279.391803:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408325504:12345-0@lo:101: 00010000:00010000:3.0:1789181279.391814:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181279.391826:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1679a00/0x76fb555283516df7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516df0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181279.391862:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1679a00/0x76fb555283516df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516df0 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181279.391874:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1679a00/0x76fb555283516df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516df0 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181279.391890:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679a00, rc 0) 00000100:00100000:3.0:1789181279.391929:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408325504:12345-0@lo:101: Request processed in 126us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.391936:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789181279.392104:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408325504:0@lo:101: 00010000:00010000:2.0:1789181279.392117:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.392126:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181279.392181:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408325632:0@lo:501: 00000100:00100000:2.0:1789181279.392214:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.392231:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181279.392382:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408325632 00000100:00100000:3.0:1789181279.392386:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408325632 00000100:00100000:3.0:1789181279.392418:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789181279.392426:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408325632:12345-0@lo:501: 00000100:00100000:3.0:1789181279.392561:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408325632:12345-0@lo:501: Request processed in 135us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.392569:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789181279.392635:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408325632:0@lo:501: 00000100:00100000:2.0:1789181279.392674:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408325760:0@lo:503: 00000100:00100000:2.0:1789181279.392715:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.392756:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.392767:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408325760 00000100:00100000:2.0:1789181279.392771:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408325760 00000100:00100000:2.0:1789181279.392788:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789181279.392794:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408325760:12345-0@lo:503: 00000100:00100000:2.0:1789181279.392891:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408325760:12345-0@lo:503: Request processed in 96us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.392898:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789181279.392935:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408325760:0@lo:503: 40000000:02000000:3.0:1789181279.399065:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1789181279.401355:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8618:1876092408325888:0@lo:502: 00000100:00100000:0.0:1789181279.401597:0:8618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181279.401742:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.402040:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408325888 00000100:00100000:2.0:1789181279.402049:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408325888 00000100:00100000:2.0:1789181279.402377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789181279.402390:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:8618:x1876092408325888:12345-0@lo:502: 00010000:00080000:0.0:1789181279.404105:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc4302a00 x1876092408325376/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789181295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181279.404123:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4302a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1876092408325376:0@lo:700: 40000000:02000000:0.0:1789181279.404137:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1789181279.404190:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1876092408325376:12345-0@lo:700: Request processed in 15587us (15673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.404201:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181279.406215:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:8618:x1876092408325888:12345-0@lo:502: Request processed in 3821us (4611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.406230:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789181279.434812:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8618:1876092408325888:0@lo:502: 00000001:00100000:2.0:1789181279.436652:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789181279.436826:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8616:x1876092408325248:12345-0@lo:700: Request processed in 48559us (48883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181279.436851:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789181279.436868:0:8616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dfb2abb80 x1876092408325248/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789181295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181279.436886:0:8616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8616:1876092408325248:0@lo:700: 00000100:00100000:2.0:1789181279.442057:0:8618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8618:1876092408326016:0@lo:502: 00000100:00100000:2.0:1789181279.442423:0:8618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.442484:0:8618:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181279.442752:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408326016 00000100:00100000:1.0:1789181279.442761:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408326016 00000100:00100000:1.0:1789181279.442815:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789181279.442823:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:8618:x1876092408326016:12345-0@lo:502: 00000100:00100000:1.0:1789181279.442956:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:8618:x1876092408326016:12345-0@lo:502: Request processed in 132us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181279.442964:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789181279.444451:0:8618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8618:1876092408326016:0@lo:502: 00000040:00080000:2.0:1789181279.444515:0:8618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789181279.444979:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789181279.445008:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181279.445018:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.445031:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181279.445041:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789181279.445044:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1dc32aa000 from 5 10000000:01000000:2.0:1789181279.445054:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789181279.445169:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.445179:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.445190:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181279.445212:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408326144:0@lo:101: 00000100:00100000:2.0:1789181279.445579:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.445617:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.445639:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408326144 00000100:00100000:2.0:1789181279.445647:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408326144 00000100:00100000:2.0:1789181279.445717:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789181279.445872:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408326144:12345-0@lo:101: 00010000:00010000:2.0:1789181279.445891:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181279.445905:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523200/0x76fb555283516e05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516dfe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.445934:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523200/0x76fb555283516e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516dfe expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.445944:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523200/0x76fb555283516e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516dfe expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.445952:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523200, rc 0) 00000100:00100000:2.0:1789181279.445989:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408326144:12345-0@lo:101: Request processed in 121us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.446004:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789181279.446046:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408326144:0@lo:101: 00010000:00010000:2.0:1789181279.446060:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.446070:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181279.446127:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408326272:0@lo:256: 00000100:00100000:2.0:1789181279.446155:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.446169:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.446179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408326272 00000100:00100000:2.0:1789181279.446182:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408326272 00000100:00100000:2.0:1789181279.446203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789181279.446210:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408326272:12345-0@lo:256: 20000000:01000000:2.0:1789181279.446406:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789181279.446425:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789181279.446429:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789181279.446525:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408326272:12345-0@lo:256: Request processed in 314us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.446533:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789181279.446567:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408326272:0@lo:256: 10000000:01000000:2.0:1789181279.446610:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789181279.446617:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.446626:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181279.446639:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789181279.446642:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789181279.446645:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789181279.446664:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.446672:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.446680:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181279.446693:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408326400:0@lo:101: 00000100:00100000:2.0:1789181279.446750:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.446774:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.446787:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408326400 00000100:00100000:2.0:1789181279.446791:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408326400 00000100:00100000:2.0:1789181279.446815:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789181279.446822:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408326400:12345-0@lo:101: 00010000:00010000:2.0:1789181279.446829:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181279.446838:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522800/0x76fb555283516e13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516e0c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.446853:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522800/0x76fb555283516e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516e0c expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.446862:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522800/0x76fb555283516e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e0c expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.446881:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522800, rc 0) 00000100:00100000:2.0:1789181279.446912:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408326400:12345-0@lo:101: Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.446919:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789181279.446953:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408326400:0@lo:101: 00010000:00010000:2.0:1789181279.446964:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.446971:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181279.447040:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408326528:0@lo:501: 00000100:00100000:2.0:1789181279.447074:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.447092:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.447110:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408326528 00000100:00100000:2.0:1789181279.447115:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408326528 00000100:00100000:2.0:1789181279.447146:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789181279.447155:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408326528:12345-0@lo:501: 00000100:00100000:2.0:1789181279.447921:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408326528:12345-0@lo:501: Request processed in 764us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.447933:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789181279.447988:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408326528:0@lo:501: 00000100:00100000:2.0:1789181279.448024:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408326656:0@lo:503: 00000100:00100000:2.0:1789181279.448077:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.448278:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.448370:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408326656 00000100:00100000:2.0:1789181279.448376:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408326656 00000100:00100000:2.0:1789181279.448406:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789181279.448414:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408326656:12345-0@lo:503: 00000100:00100000:2.0:1789181279.448521:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408326656:12345-0@lo:503: Request processed in 107us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.448528:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789181279.448572:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408326656:0@lo:503: 00000100:00100000:3.0:1789181279.449175:0:8622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8622:1876092408326784:0@lo:502: 00000100:00100000:3.0:1789181279.449227:0:8622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181279.449256:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408326784 00000100:00100000:3.0:1789181279.449261:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408326784 00000100:00100000:3.0:1789181279.449292:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789181279.449299:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:8622:x1876092408326784:12345-0@lo:502: 00000100:00100000:3.0:1789181279.449513:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:8622:x1876092408326784:12345-0@lo:502: Request processed in 214us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.449521:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789181279.449564:0:8622:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb340cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181279.449588:0:8622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8622:1876092408326784:0@lo:502: 00000020:01000000:3.0:1789181279.449613:0:8622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789181279.449622:0:8622:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789181279.449630:0:8622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181279.449633:0:8622:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789181279.449638:0:8622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789181279.449641:0:8622:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:3.0:1789181279.449667:0:8622:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789181279.449670:0:8622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789181279.449686:0:8622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c1dc4e03380) 00000020:00000080:3.0:1789181279.449744:0:8622:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789181279.449751:0:8622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789181279.449835:0:8622:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789181279.449840:0:8622:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789181279.449847:0:8622:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283516e21 00010000:00080000:3.0:1789181279.449877:0:8622:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1dff8a6800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1789181279.450112:0:8622:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:1.0:1789181279.450998:0:8616:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789181279.451019:0:8616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8616:1876092408327040:0@lo:7: 00000100:00100000:1.0:1789181279.451064:0:8616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181279.451160:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181279.451171:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408326912:0@lo:13: 00000100:00100000:1.0:1789181279.451278:0:8616:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.451380:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408327040 00000100:00100000:2.0:1789181279.451386:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408327040 00000100:00100000:2.0:1789181279.451430:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181279.451437:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8616:x1876092408327040:12345-0@lo:7: 00000100:00100000:0.0:1789181279.451532:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.451587:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408326912 00000100:00100000:1.0:1789181279.451594:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408326912 00000100:00100000:1.0:1789181279.451640:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181279.451650:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1876092408326912:12345-0@lo:13: 00002000:00000024:1.0:1789181279.451670:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:1.0:1789181279.451747:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1876092408326912:12345-0@lo:13: Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181279.451757:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789181279.451866:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dfb2ab480 x1876092408326912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181279.451960:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408326912:0@lo:13: 00002000:00080000:3.0:1789181279.457362:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789181279.457371:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789181279.457660:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8616:x1876092408327040:12345-0@lo:7: Request processed in 6217us (6590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.457673:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789181279.458028:0:8616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dfb2a8000 x1876092408327040/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789181295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181279.458047:0:8616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8616:1876092408327040:0@lo:7: 00000004:00080000:1.0:1789181279.458064:0:8616:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789181279.458108:0:8616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8616:1876092408327168:0@lo:5: 00000100:00100000:1.0:1789181279.458165:0:8616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.458212:0:8616:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181279.458287:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408327168 00000100:00100000:0.0:1789181279.458297:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408327168 00000100:00100000:0.0:1789181279.458360:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181279.458373:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8616:x1876092408327168:12345-0@lo:5: 00002000:00080000:0.0:1789181279.458407:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789181279.458452:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8616:x1876092408327168:12345-0@lo:5: Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181279.458472:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789181279.458543:0:8616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dfb2a8000 x1876092408327168/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181279.458554:0:8616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8616:1876092408327168:0@lo:5: 00000004:00080000:1.0:1789181279.458562:0:8616:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789181279.458585:0:8616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8616:1876092408327296:0@lo:5: 00000100:00100000:1.0:1789181279.458606:0:8616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.458661:0:8616:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181279.460249:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408327296 00000100:00100000:0.0:1789181279.460262:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408327296 00000100:00100000:0.0:1789181279.460904:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181279.460919:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8616:x1876092408327296:12345-0@lo:5: 00002000:00080000:0.0:1789181279.460964:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000040:01000000:1.0:1789181279.463261:0:8622:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789181279.463285:0:8622:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789181279.463442:0:8622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181279.463828:0:8622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181279.463981:0:8622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789181279.464131:0:8622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:3.0:1789181279.465867:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8616:x1876092408327296:12345-0@lo:5: Request processed in 4947us (7253us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789181279.465881:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789181279.465938:0:8616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dfb2a8000 x1876092408327296/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181279.465958:0:8616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8616:1876092408327296:0@lo:5: 00000004:00080000:3.0:1789181279.465976:0:8616:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789181279.466026:0:8616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8616:1876092408327424:0@lo:900: 00000100:00100000:3.0:1789181279.466067:0:8616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181279.467612:0:8616:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb340840 going to sleep for 11 seconds 00000040:00080000:1.0:1789181279.467760:0:8624:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181279.467767:0:8624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1789181279.467786:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408327424 00000100:00100000:3.0:1789181279.467796:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408327424 00000100:00100000:3.0:1789181279.467843:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181279.467852:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8616:x1876092408327424:12345-0@lo:900: 00000100:00100000:3.0:1789181279.467927:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8616:x1876092408327424:12345-0@lo:900: Request processed in 77us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.467935:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789181279.467963:0:8616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc4300380 x1876092408327424/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789181295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181279.467978:0:8616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8616:1876092408327424:0@lo:900: 00000020:00000080:3.0:1789181279.469285:0:8622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789181279.469305:0:8622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789181279.469486:0:8622:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789181279.469514:0:8622:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb555283516e28 00000100:00080000:3.0:1789181279.469523:0:8622:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789181279.469535:0:8622:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c1dff8a6800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181279.469570:0:8622:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc4303b80 x1876092408327552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789181279.469598:0:8622:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789181279.469680:0:8622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181279.469685:0:8622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181279.469686:0:8622:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789181279.469691:0:8622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181279.469695:0:8622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181279.469696:0:8622:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789181279.469699:0:8622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789181279.469701:0:8622:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789181279.469720:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408327552:0@lo:8: 00000100:00100000:3.0:1789181279.469744:0:8622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8622:1876092408327680:0@lo:502: 00000100:00100000:3.0:1789181279.469817:0:8622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181279.469823:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.469873:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408327680 00000100:00100000:2.0:1789181279.469881:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408327680 00000100:00100000:2.0:1789181279.469923:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789181279.469938:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:8622:x1876092408327680:12345-0@lo:502: 00000100:00100000:3.0:1789181279.469959:0:8622:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb340a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.470056:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:8622:x1876092408327680:12345-0@lo:502: Request processed in 125us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.470064:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789181279.470139:0:8622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:8622:1876092408327680:0@lo:502: 00000020:01000000:3.0:1789181279.470164:0:8622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181279.470167:0:8622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181279.470168:0:8622:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789181279.470171:0:8622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789181279.470237:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789181279.470258:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789181279.470268:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181279.470279:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181279.470289:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789181279.470298:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c1dd13ecd40 from 1 10000000:01000000:2.0:1789181279.470301:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1789181279.470890:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408327552 00000100:00100000:0.0:1789181279.470899:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408327552 00000100:00100000:0.0:1789181279.470937:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181279.470944:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1876092408327552:12345-0@lo:8: 00010000:00080000:0.0:1789181279.470988:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:0.0:1789181279.471024:0:8436:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb555283516e2f 00002000:00100000:0.0:1789181279.471039:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c1de7f4a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789181279.471043:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789181279.471046:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789181279.471119:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789181279.471142:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f48000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181279.471201:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876092408327552:12345-0@lo:8: Request processed in 256us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181279.471208:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789181279.471319:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc4303b80 x1876092408327552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181279.471330:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789181279.471338:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789181279.471347:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789181279.471353:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789181279.471356:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1dff8a6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789181279.471372:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789181279.471378:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408327552:0@lo:8: 00000004:00080000:1.0:1789181279.471465:0:8624:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789181279.471529:0:8624:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 235458804735ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789181279.471538:0:8624:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1789181279.473660:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181279.473804:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181279.473821:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181279.473853:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408327808:0@lo:101: 00000100:00100000:3.0:1789181279.473944:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181279.474001:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb340a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181279.474039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408327808 00000100:00100000:1.0:1789181279.474055:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408327808 00000100:00100000:1.0:1789181279.474157:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789181279.474171:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408327808:12345-0@lo:101: 00010000:00010000:1.0:1789181279.474197:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181279.474229:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e021f1a00/0x76fb555283516e3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516e36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181279.474264:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e021f1a00/0x76fb555283516e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516e36 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181279.474275:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e021f1a00/0x76fb555283516e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e36 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181279.474286:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e021f1a00, rc 0) 00000100:00100000:1.0:1789181279.474352:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408327808:12345-0@lo:101: Request processed in 185us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181279.474360:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789181279.474507:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408327808:0@lo:101: 00010000:00010000:3.0:1789181279.474526:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181279.474536:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181279.474620:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408327936:0@lo:501: 00000100:00100000:3.0:1789181279.474649:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181279.474800:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb340a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181279.474879:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408327936 00000100:00100000:0.0:1789181279.474885:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408327936 00000100:00100000:0.0:1789181279.474911:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789181279.474920:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408327936:12345-0@lo:501: 00000100:00100000:0.0:1789181279.475011:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408327936:12345-0@lo:501: Request processed in 92us (361us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789181279.475018:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789181279.475071:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408327936:0@lo:501: 10000000:01000000:0.0:1789181279.475102:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789181279.475109:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181279.475119:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789181279.475301:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789181279.480495:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408328064:0@lo:13: 00000100:00100000:0.0:1789181279.480570:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181279.480656:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408328064 00000100:00100000:2.0:1789181279.480665:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408328064 00000100:00100000:2.0:1789181279.480771:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181279.480782:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408328064:12345-0@lo:13: 00002000:00000024:2.0:1789181279.480811:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000004:00080000:1.0:1789181279.480893:0:8625:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789181279.480918:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8625:1876092408328192:0@lo:7: 00000100:00100000:1.0:1789181279.480949:0:8625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181279.480978:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408328192 00000100:00100000:1.0:1789181279.480979:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181279.480983:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408328192 00000100:00100000:3.0:1789181279.481020:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181279.481026:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8625:x1876092408328192:12345-0@lo:7: 00000100:00100000:2.0:1789181279.481073:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876092408328064:12345-0@lo:13: Request processed in 293us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181279.481082:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789181279.481112:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181279.481156:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dfb2abb80 x1876092408328064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181279.481172:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408328064:0@lo:13: 00002000:00080000:3.0:1789181279.487008:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789181279.487016:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789181279.487098:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8625:x1876092408328192:12345-0@lo:7: Request processed in 6067us (6143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.487109:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789181279.487138:0:8625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbfb80 x1876092408328192/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789181295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181279.487155:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8625:1876092408328192:0@lo:7: 00000004:00080000:1.0:1789181279.487169:0:8625:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789181279.487206:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8625:1876092408328320:0@lo:5: 00000100:00100000:1.0:1789181279.487244:0:8625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.487280:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210000 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.487310:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408328320 00000100:00100000:2.0:1789181279.487317:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408328320 00000100:00100000:2.0:1789181279.487361:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789181279.487372:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8625:x1876092408328320:12345-0@lo:5: 00000100:00100000:1.0:1789181279.487382:0:8436:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789181279.487392:0:8436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:2.0:1789181279.487399:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789181279.487403:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1789181279.490333:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00100000:1.0:1789181279.490354:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789181279.490361:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1789181279.490539:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8625:x1876092408328320:12345-0@lo:5: Request processed in 3162us (3287us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789181279.490557:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789181279.490572:0:8625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbfb80 x1876092408328320/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181279.490585:0:8625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789181279.490593:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8625:1876092408328320:0@lo:5: 00000004:00080000:1.0:1789181279.490625:0:8625:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789181279.491075:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8625:1876092408328448:0@lo:700: 00000100:00100000:1.0:1789181279.491114:0:8625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181279.491144:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210000 going to sleep for 11 seconds 00000100:00100000:2.0:1789181279.491164:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408328448 00000100:00100000:2.0:1789181279.491172:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408328448 00000100:00100000:2.0:1789181279.491241:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181279.491248:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8625:x1876092408328448:12345-0@lo:700: 00000100:00100000:3.0:1789181279.516964:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8625:x1876092408328448:12345-0@lo:700: Request processed in 25705us (25839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181279.516975:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789181279.517089:0:8625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbfb80 x1876092408328448/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789181295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181279.517105:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8625:1876092408328448:0@lo:700: 00000004:02000040:0.0:1789181279.518222:0:8625:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1789181279.520170:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8625:1876092408328576:0@lo:5: 00000100:00100000:0.0:1789181279.520221:0:8625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181279.520259:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181279.520388:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408328576 00000100:00100000:3.0:1789181279.520394:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408328576 00000100:00100000:3.0:1789181279.520440:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181279.520447:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8625:x1876092408328576:12345-0@lo:5: 00002000:00080000:3.0:1789181279.523209:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789181279.523285:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1789181279.524430:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8625:x1876092408328576:12345-0@lo:5: Request processed in 3973us (4198us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789181279.524443:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789181279.524480:0:8625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dfb57df80 x1876092408328576/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181279.524500:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8625:1876092408328576:0@lo:5: 00000004:00080000:0.0:1789181279.524517:0:8625:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1789181279.759971:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181280.524509:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181280.524534:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408328704:0@lo:41: 00000100:00100000:1.0:1789181280.524621:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181280.524686:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408328704 00000100:00100000:1.0:1789181280.524694:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408328704 00000100:00100000:1.0:1789181280.524764:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789181280.524773:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408328704:12345-0@lo:41: 00000004:00000024:1.0:1789181280.524805:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789181280.524863:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408328704:12345-0@lo:41: Request processed in 91us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181280.524870:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789181280.524927:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408328704:0@lo:41: 00010000:00010000:0.0:1789181280.779970:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181281.809622:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181282.829836:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181283.086701:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181283.086758:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408328832:0@lo:41: 00000100:00100000:3.0:1789181283.087247:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181283.087480:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408328832 00000100:00100000:3.0:1789181283.087488:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408328832 00000100:00100000:3.0:1789181283.087535:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181283.087550:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408328832:12345-0@lo:41: 00000004:00000024:3.0:1789181283.088561:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789181283.088639:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408328832:12345-0@lo:41: Request processed in 1088us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181283.088648:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181283.088716:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408328832:0@lo:41: 00010000:00010000:2.0:1789181283.862933:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789181284.150958:0:8813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789181284.621261:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408329088:0@lo:400: 00000100:00100000:3.0:1789181284.621326:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181284.621366:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408329600:0@lo:400: 00000100:00100000:3.0:1789181284.621385:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181284.621428:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789181284.621436:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408328960:0@lo:400: 00000100:00100000:3.0:1789181284.621460:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181284.621488:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408329472:0@lo:400: 00000100:00100000:3.0:1789181284.621507:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181284.621521:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408329984:0@lo:400: 00000100:00100000:3.0:1789181284.621542:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181284.621561:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408329216:0@lo:400: 00000100:00100000:3.0:1789181284.621578:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181284.621590:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408329728:0@lo:400: 00000100:00100000:3.0:1789181284.621605:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181284.621616:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789181284.621621:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408329344:0@lo:400: 00000100:00100000:3.0:1789181284.621636:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181284.621644:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408329856:0@lo:400: 00000100:00100000:3.0:1789181284.621668:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181284.621694:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408329088 00000100:00100000:3.0:1789181284.621701:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408329088 00000100:00100000:3.0:1789181284.621752:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408329600 00000100:00100000:3.0:1789181284.621755:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408329600 00000100:00100000:3.0:1789181284.621774:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408329728 00000100:00100000:3.0:1789181284.621777:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408329728 00000100:00100000:3.0:1789181284.621786:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408329344 00000100:00100000:3.0:1789181284.621788:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408329344 00000100:00100000:3.0:1789181284.621800:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789181284.621808:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408329088:12345-0@lo:400: 00000100:00100000:3.0:1789181284.621852:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408329088:12345-0@lo:400: Request processed in 45us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181284.621859:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789181284.621874:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789181284.621879:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408329600:12345-0@lo:400: 00000100:00100000:3.0:1789181284.621899:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408329600:12345-0@lo:400: Request processed in 20us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181284.621905:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789181284.621913:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789181284.622375:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408328960 00000100:00100000:0.0:1789181284.622382:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408328960 00000100:00100000:0.0:1789181284.622427:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789181284.622435:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:3646:x1876092408328960:12345-0@lo:400: 00000100:00100000:0.0:1789181284.622477:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:3646:x1876092408328960:12345-0@lo:400: Request processed in 43us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181284.622484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789181284.623818:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181284.623837:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408330112:0@lo:13: 00000100:00100000:2.0:1789181284.623892:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181284.623933:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181284.623941:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408330240:0@lo:13: 00000100:00100000:2.0:1789181284.623964:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181284.623986:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408329984 00000100:00100000:2.0:1789181284.623991:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408329984 00000100:00100000:2.0:1789181284.624027:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408329856 00000100:00100000:2.0:1789181284.624029:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408329856 00000100:00100000:2.0:1789181284.624048:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181284.624055:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408329984:12345-0@lo:400: 00000100:00100000:2.0:1789181284.624091:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408329984:12345-0@lo:400: Request processed in 37us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181284.624098:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181284.624111:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181284.624116:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408329856:12345-0@lo:400: 00000100:00100000:2.0:1789181284.624138:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408329856:12345-0@lo:400: Request processed in 22us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181284.624144:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181284.624340:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408329728:12345-0@lo:400: 00000100:00100000:3.0:1789181284.624373:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408329728:12345-0@lo:400: Request processed in 36us (2766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181284.624398:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789181284.624407:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408329344:12345-0@lo:400: 00000100:00100000:2.0:1789181284.624446:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408329344:12345-0@lo:400: Request processed in 41us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181284.624452:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789181284.624473:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181284.624477:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181284.624479:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181284.624487:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408330112 00000100:00100000:2.0:1789181284.624490:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408330112 00000100:00100000:2.0:1789181284.624512:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408330240 00000100:00100000:2.0:1789181284.624515:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408330240 00000100:00100000:2.0:1789181284.624528:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181284.624534:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408330112:12345-0@lo:13: 00002000:00000024:2.0:1789181284.624553:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181284.624585:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408330112:12345-0@lo:13: Request processed in 52us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181284.624591:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181284.624613:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181284.624618:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408330240:12345-0@lo:13: 00002000:00000024:2.0:1789181284.624627:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181284.624648:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408330240:12345-0@lo:13: Request processed in 31us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181284.624654:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789181284.624686:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2756300 x1876092408330112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181284.624695:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789181284.624718:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408330112:0@lo:13: 00010000:00080000:2.0:1789181284.624772:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dfb57dc00 x1876092408330240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181284.624785:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408330240:0@lo:13: 00000100:00100000:1.0:1789181284.627819:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408329472 00000100:00100000:1.0:1789181284.627835:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408329472 00000100:00100000:1.0:1789181284.627893:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408329216 00000100:00100000:1.0:1789181284.627897:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408329216 00010000:00080000:2.0:1789181284.630568:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dd136c380 x1876092408329344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181284.630586:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408329344:0@lo:400: 00010000:00080000:2.0:1789181284.630613:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dd136ce00 x1876092408329856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181284.630631:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408329856:0@lo:400: 00010000:00080000:2.0:1789181284.630664:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dd136ca80 x1876092408329728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181284.630674:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408329728:0@lo:400: 00000100:00100000:2.0:1789181284.630737:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408328960:0@lo:400: 00010000:00080000:2.0:1789181284.630751:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f65880 x1876092408329984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181284.630762:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408329984:0@lo:400: 00010000:00080000:2.0:1789181284.630774:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dd136f480 x1876092408329088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181284.630782:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408329088:0@lo:400: 00010000:00080000:2.0:1789181284.630795:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dd136e680 x1876092408329600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181284.630803:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408329600:0@lo:400: 00000100:00100000:3.0:1789181284.630937:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181284.631650:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789181284.631666:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408329472:12345-0@lo:400: 00000100:00100000:1.0:1789181284.631789:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408329472:12345-0@lo:400: Request processed in 128us (10279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181284.631797:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789181284.631816:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789181284.631824:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408329216:12345-0@lo:400: 00000100:00100000:1.0:1789181284.631869:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408329216:12345-0@lo:400: Request processed in 46us (10289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181284.631876:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789181284.631889:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408329472:0@lo:400: 00000100:00100000:3.0:1789181284.631994:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408329216:0@lo:400: 00010000:00010000:1.0:1789181284.875861:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789181285.139846:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000020:00000004:3.0:1789181285.458572:0:8865:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181285.459160:0:8865:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789181285.649210:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408330368:0@lo:41: 00000100:00100000:3.0:1789181285.649277:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181285.649347:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408330368 00000100:00100000:3.0:1789181285.649355:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408330368 00000100:00100000:3.0:1789181285.649398:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789181285.649417:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408330368:12345-0@lo:41: 00000004:00000024:3.0:1789181285.649451:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789181285.649493:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408330368:12345-0@lo:41: Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181285.649500:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789181285.649562:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408330368:0@lo:41: 00010000:00010000:0.0:1789181285.915940:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181286.924203:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181287.948531:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181288.206608:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408330496:0@lo:41: 00000100:00100000:2.0:1789181288.206697:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181288.207199:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408330496 00000100:00100000:3.0:1789181288.207208:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408330496 00000100:00100000:3.0:1789181288.207271:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789181288.207281:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408330496:12345-0@lo:41: 00000004:00000024:3.0:1789181288.207315:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789181288.207362:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408330496:12345-0@lo:41: Request processed in 83us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181288.207369:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789181288.207483:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408330496:0@lo:41: 00000020:00000004:3.0:1789181288.667548:0:8966:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181288.668312:0:8966:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789181288.976660:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789181289.638777:0:9014:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181289.638789:0:9014:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789181289.740300:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181289.740326:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408330624:0@lo:13: 00000100:00100000:0.0:1789181289.740407:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181289.740428:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408330624 00000100:00100000:2.0:1789181289.740438:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408330624 00000100:00100000:0.0:1789181289.740491:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408330752:0@lo:13: 00000100:00100000:2.0:1789181289.740503:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181289.740517:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408330624:12345-0@lo:13: 00000100:00100000:0.0:1789181289.740525:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789181289.740549:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181289.740625:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408330624:12345-0@lo:13: Request processed in 111us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181289.740632:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181289.740654:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408330752 00000100:00100000:2.0:1789181289.740658:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408330752 00000100:00100000:2.0:1789181289.740682:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181289.740690:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408330752:12345-0@lo:13: 00000100:00100000:3.0:1789181289.740703:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408331136:0@lo:400: 00002000:00000024:2.0:1789181289.740703:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181289.740787:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408330880:0@lo:400: 00000100:00100000:1.0:1789181289.744863:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408331008:0@lo:400: 00000100:00100000:3.0:1789181289.745515:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181289.746056:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408331136 00000100:00100000:3.0:1789181289.746066:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408331136 00000100:00100000:3.0:1789181289.746603:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789181289.746615:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408331136:12345-0@lo:400: 00000100:00100000:0.0:1789181289.747554:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181289.747564:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181289.747598:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408330880 00000100:00100000:0.0:1789181289.747606:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408330880 00000100:00100000:1.0:1789181289.747623:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408331520:0@lo:400: 00000100:00100000:0.0:1789181289.747645:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789181289.747657:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789181289.747699:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc437b800 x1876092408330624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181289.747720:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408330624:0@lo:13: 00000100:00100000:0.0:1789181289.747789:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:3644:x1876092408330880:12345-0@lo:400: 00000100:00100000:0.0:1789181289.747831:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:3644:x1876092408330880:12345-0@lo:400: Request processed in 178us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181289.747838:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789181289.747892:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408331264:0@lo:400: 00000100:00100000:0.0:1789181289.747930:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789181289.747971:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dfb57ce00 x1876092408330752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181289.747981:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789181289.747997:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408330752:0@lo:13: 00000100:00100000:0.0:1789181289.748023:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408331008 00000100:00100000:0.0:1789181289.748028:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408331008 00000100:00100000:0.0:1789181289.748053:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408331520 00000100:00100000:0.0:1789181289.748056:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408331520 00000100:00100000:0.0:1789181289.748074:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408331264 00000100:00100000:0.0:1789181289.748077:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408331264 00000100:00100000:0.0:1789181289.748107:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789181289.748114:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408331008:12345-0@lo:400: 00000100:00100000:2.0:1789181289.748224:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408330752:12345-0@lo:13: Request processed in 7533us (7697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181289.748234:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789181289.748259:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181289.748264:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181289.748405:0:6522:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789181289.748413:0:6522:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789181289.748522:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789181289.748530:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408331520:12345-0@lo:400: 00000100:00100000:2.0:1789181289.748860:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408331520:12345-0@lo:400: Request processed in 329us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181289.748865:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408331008:12345-0@lo:400: Request processed in 748us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181289.748872:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789181289.748878:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789181289.748895:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181289.748906:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408331264:12345-0@lo:400: 00000100:00100000:0.0:1789181289.748934:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408330880:0@lo:400: 00000100:00100000:0.0:1789181289.748945:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408331392:0@lo:400: 00000100:00100000:0.0:1789181289.748973:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181289.748997:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408331392 00000100:00100000:0.0:1789181289.749002:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408331392 00000100:00100000:2.0:1789181289.749026:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408331264:12345-0@lo:400: Request processed in 121us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181289.749027:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181289.749038:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408331392:12345-0@lo:400: 00000100:00100000:2.0:1789181289.749039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789181289.749084:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408331392:12345-0@lo:400: Request processed in 43us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181289.749091:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789181289.749141:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f67480 x1876092408331264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181289.749152:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408331264:0@lo:400: 00000100:00100000:0.0:1789181289.749176:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408331392:0@lo:400: 00000100:00100000:2.0:1789181289.749997:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408331136:0@lo:400: 00000100:00100000:2.0:1789181289.750009:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408331648:0@lo:400: 00000100:00100000:2.0:1789181289.750053:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181289.751657:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408331648 00000100:00100000:0.0:1789181289.751671:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408331648 00000100:00100000:0.0:1789181289.751767:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789181289.751778:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408331648:12345-0@lo:400: 00000100:00080000:2.0:1789181289.751813:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181289.751860:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408331648:12345-0@lo:400: Request processed in 83us (1805us total) trans 0 rc 0/0 00010000:00080000:2.0:1789181289.751891:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f67100 x1876092408331648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181289.751906:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408331648:0@lo:400: 00000100:00100000:0.0:1789181289.751927:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789181289.752447:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408331136:12345-0@lo:400: Request processed in 5831us (6931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181289.752456:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789181289.752797:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f66680 x1876092408331008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181289.752811:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408331008:0@lo:400: 00010000:00080000:1.0:1789181289.752826:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f64000 x1876092408331520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181289.752843:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408331520:0@lo:400: 00010000:00010000:0.0:1789181289.995926:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181290.764870:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408331776:0@lo:41: 00000100:00100000:3.0:1789181290.764962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181290.765044:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408331776 00000100:00100000:3.0:1789181290.765053:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408331776 00000100:00100000:3.0:1789181290.765100:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789181290.765110:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408331776:12345-0@lo:41: 00000004:00000024:3.0:1789181290.765161:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789181290.765209:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408331776:12345-0@lo:41: Request processed in 101us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181290.765216:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789181290.765264:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408331776:0@lo:41: 00010000:00010000:1.0:1789181291.023898:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181292.045039:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181293.069509:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181293.324394:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408331904:0@lo:41: 00000100:00100000:0.0:1789181293.324463:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181293.324543:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408331904 00000100:00100000:0.0:1789181293.324554:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408331904 00000100:00100000:0.0:1789181293.324603:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789181293.324612:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408331904:12345-0@lo:41: 00000004:00000024:0.0:1789181293.324690:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789181293.324772:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408331904:12345-0@lo:41: Request processed in 160us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181293.324780:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789181293.324824:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408331904:0@lo:41: 00010000:00010000:0.0:1789181294.093043:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181294.860150:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408332032:0@lo:400: 00000100:00100000:3.0:1789181294.860222:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181294.860276:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408332544:0@lo:400: 00000100:00100000:3.0:1789181294.860304:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181294.860415:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408333056:0@lo:400: 00000100:00100000:3.0:1789181294.860441:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181294.860466:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789181294.860473:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408332160:0@lo:400: 00000100:00100000:3.0:1789181294.860533:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181294.860553:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408332672:0@lo:400: 00000100:00100000:3.0:1789181294.860584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181294.860613:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408332288:0@lo:400: 00000100:00100000:3.0:1789181294.860634:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181294.860649:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408332800:0@lo:400: 00000100:00100000:3.0:1789181294.860666:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181294.860682:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789181294.860688:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408332416:0@lo:400: 00000100:00100000:0.0:1789181294.860702:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408332032 00000100:00100000:3.0:1789181294.860705:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181294.860710:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408332032 00000100:00100000:3.0:1789181294.860720:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408332928:0@lo:400: 00000100:00100000:3.0:1789181294.860783:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181294.860783:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789181294.860792:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:3645:x1876092408332032:12345-0@lo:400: 00000100:00100000:3.0:1789181294.860810:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408332544 00000100:00100000:3.0:1789181294.860814:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408332544 00000100:00100000:3.0:1789181294.860835:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408332288 00000100:00100000:3.0:1789181294.860838:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408332288 00000100:00100000:0.0:1789181294.860840:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:3645:x1876092408332032:12345-0@lo:400: Request processed in 50us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181294.860848:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789181294.860849:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789181294.860854:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408332544:12345-0@lo:400: 00000100:00100000:0.0:1789181294.860877:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408332160 00000100:00100000:0.0:1789181294.860880:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408332160 00000100:00100000:3.0:1789181294.860884:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408332544:12345-0@lo:400: Request processed in 30us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181294.860890:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789181294.860895:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408332672 00000100:00100000:0.0:1789181294.860897:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408332672 00000100:00100000:3.0:1789181294.860900:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181294.860906:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408332288:12345-0@lo:400: 00000100:00100000:3.0:1789181294.860936:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408332288:12345-0@lo:400: Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181294.860942:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181294.860958:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408333056 00000100:00100000:3.0:1789181294.860962:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408333056 00000100:00100000:0.0:1789181294.860998:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408332800 00000100:00100000:0.0:1789181294.861002:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408332800 00000100:00100000:2.0:1789181294.861115:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408332416 00000100:00100000:2.0:1789181294.861119:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408332416 00000100:00100000:2.0:1789181294.861155:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181294.861162:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408332160:12345-0@lo:400: 00000100:00100000:2.0:1789181294.861194:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408332160:12345-0@lo:400: Request processed in 33us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181294.861200:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181294.861212:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181294.861217:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408332672:12345-0@lo:400: 00000100:00100000:2.0:1789181294.861241:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408332672:12345-0@lo:400: Request processed in 24us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181294.861247:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181294.861258:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789181294.861263:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408332416:12345-0@lo:400: 00000100:00100000:2.0:1789181294.861287:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408332416:12345-0@lo:400: Request processed in 24us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181294.861293:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789181294.861880:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408332928 00000100:00100000:3.0:1789181294.861891:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408332928 00000100:00100000:3.0:1789181294.861917:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181294.861925:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408333056:12345-0@lo:400: 00000100:00100000:3.0:1789181294.861965:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408333056:12345-0@lo:400: Request processed in 41us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181294.861970:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181294.861981:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181294.861986:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408332928:12345-0@lo:400: 00000100:00100000:3.0:1789181294.862012:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408332928:12345-0@lo:400: Request processed in 26us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181294.862017:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181294.862052:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181294.862062:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408333312:0@lo:13: 00000100:00100000:3.0:1789181294.862089:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181294.862120:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408333312 00000100:00100000:3.0:1789181294.862123:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408333312 00000100:00100000:3.0:1789181294.862145:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181294.862151:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408333312:12345-0@lo:13: 00002000:00000024:3.0:1789181294.862170:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181294.862202:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408333312:12345-0@lo:13: Request processed in 51us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181294.862209:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789181294.862243:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2754a80 x1876092408333312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181294.862262:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408333312:0@lo:13: 00000100:00100000:3.0:1789181294.862284:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408333184:0@lo:13: 00000100:00100000:3.0:1789181294.862314:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181294.862351:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408333184 00000100:00100000:3.0:1789181294.862354:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408333184 00000100:00100000:3.0:1789181294.862372:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181294.862378:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408333184:12345-0@lo:13: 00002000:00000024:3.0:1789181294.862387:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181294.862415:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408333184:12345-0@lo:13: Request processed in 37us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181294.862420:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789181294.862442:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc4379880 x1876092408333184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181294.862455:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408333184:0@lo:13: 00010000:00080000:3.0:1789181294.862479:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f64700 x1876092408332416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181294.862488:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408332416:0@lo:400: 00010000:00080000:3.0:1789181294.862497:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2558e00 x1876092408332928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181294.862503:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408332928:0@lo:400: 00000100:00100000:3.0:1789181294.862513:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408332288:0@lo:400: 00000100:00080000:1.0:1789181294.863932:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181294.863940:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181294.863942:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789181294.863981:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f67100 x1876092408332160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181294.863995:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408332160:0@lo:400: 00010000:00080000:1.0:1789181294.864009:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f67480 x1876092408332672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181294.864017:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408332672:0@lo:400: 00000100:00100000:1.0:1789181294.864027:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408332032:0@lo:400: 00000100:00100000:1.0:1789181294.864038:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408332544:0@lo:400: 00010000:00080000:1.0:1789181294.864048:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc255b800 x1876092408333056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181294.864055:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408333056:0@lo:400: 00000100:00100000:0.0:1789181294.864963:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181294.864977:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408332800:12345-0@lo:400: 00000100:00100000:0.0:1789181294.865059:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408332800:12345-0@lo:400: Request processed in 86us (4391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181294.865066:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789181294.865168:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f65880 x1876092408332800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181294.865179:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408332800:0@lo:400: 00010000:00010000:1.0:1789181295.117855:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181295.885290:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408333440:0@lo:41: 00000100:00100000:2.0:1789181295.885374:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181295.886406:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408333440 00000100:00100000:0.0:1789181295.886416:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408333440 00000100:00100000:0.0:1789181295.886480:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789181295.886491:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408333440:12345-0@lo:41: 00000004:00000024:0.0:1789181295.886528:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789181295.896938:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408333440:12345-0@lo:41: Request processed in 10437us (11553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181295.896954:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789181295.902047:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408333440:0@lo:41: 00010000:00010000:0.0:1789181296.140845:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181297.164904:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181298.195531:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181298.447815:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181298.447841:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408333568:0@lo:41: 00000100:00100000:2.0:1789181298.447941:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181298.449372:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408333568 00000100:00100000:1.0:1789181298.449384:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408333568 00000100:00100000:1.0:1789181298.449459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789181298.449471:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408333568:12345-0@lo:41: 00000004:00000024:1.0:1789181298.449509:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789181298.449607:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408333568:12345-0@lo:41: Request processed in 138us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181298.449615:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789181298.453416:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408333568:0@lo:41: 00010000:00010000:1.0:1789181299.214422:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181299.984456:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408333696:0@lo:400: 00000100:00100000:2.0:1789181299.984605:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.984653:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408334208:0@lo:400: 00000100:00100000:2.0:1789181299.984679:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.984706:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408334720:0@lo:400: 00000100:00100000:2.0:1789181299.984743:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.984770:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789181299.984776:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408334080:0@lo:400: 00000100:00100000:2.0:1789181299.984798:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.984814:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408334592:0@lo:400: 00000100:00100000:2.0:1789181299.984831:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.984854:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408333952:0@lo:400: 00000100:00100000:2.0:1789181299.984876:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.984896:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408334464:0@lo:400: 00000100:00100000:2.0:1789181299.984934:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.984954:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789181299.984961:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408333824:0@lo:400: 00000100:00100000:2.0:1789181299.984980:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.984999:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408334336:0@lo:400: 00000100:00100000:2.0:1789181299.985017:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.985554:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408334848:0@lo:13: 00000100:00100000:2.0:1789181299.985587:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.985628:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408334720 00000100:00100000:2.0:1789181299.985636:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408334720 00000100:00100000:2.0:1789181299.985695:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408334592 00000100:00100000:2.0:1789181299.985699:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408334592 00000100:00100000:2.0:1789181299.985749:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181299.985758:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408334720:12345-0@lo:400: 00000100:00100000:2.0:1789181299.985813:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408334720:12345-0@lo:400: Request processed in 55us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181299.985820:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181299.985838:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181299.985843:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408334592:12345-0@lo:400: 00000100:00100000:2.0:1789181299.985869:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408334592:12345-0@lo:400: Request processed in 26us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181299.985875:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181299.985892:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408334080 00000100:00100000:2.0:1789181299.985895:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408334080 00000100:00100000:2.0:1789181299.985910:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408334464 00000100:00100000:2.0:1789181299.985912:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408334464 00000100:00100000:2.0:1789181299.985923:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408333824 00000100:00100000:2.0:1789181299.985925:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408333824 00000100:00100000:2.0:1789181299.985933:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408334336 00000100:00100000:2.0:1789181299.985935:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408334336 00000100:00100000:2.0:1789181299.985945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789181299.985951:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408334080:12345-0@lo:400: 00000100:00100000:2.0:1789181299.985977:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408334080:12345-0@lo:400: Request processed in 26us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181299.985982:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789181299.986000:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181299.986005:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408334464:12345-0@lo:400: 00000100:00100000:2.0:1789181299.986038:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408334464:12345-0@lo:400: Request processed in 33us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181299.986323:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181299.986339:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789181299.986346:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408333824:12345-0@lo:400: 00000100:00100000:2.0:1789181299.986435:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408333824:12345-0@lo:400: Request processed in 33us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181299.986442:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789181299.986453:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789181299.986458:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408334336:12345-0@lo:400: 00000100:00100000:2.0:1789181299.986536:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408334336:12345-0@lo:400: Request processed in 77us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181299.986542:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789181299.986569:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408334208 00000100:00100000:2.0:1789181299.986573:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408334208 00000100:00100000:2.0:1789181299.986596:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408333952 00000100:00100000:2.0:1789181299.986599:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408333952 00000100:00100000:2.0:1789181299.986612:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789181299.986618:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408334208:12345-0@lo:400: 00000100:00100000:2.0:1789181299.986651:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408334208:12345-0@lo:400: Request processed in 34us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181299.986657:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789181299.986669:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789181299.986675:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408333952:12345-0@lo:400: 00000100:00100000:2.0:1789181299.986700:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408333952:12345-0@lo:400: Request processed in 26us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181299.986713:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789181299.986758:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408334848 00000100:00100000:2.0:1789181299.986762:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408334848 00000100:00100000:2.0:1789181299.986789:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789181299.986794:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408334848:12345-0@lo:13: 00002000:00000024:2.0:1789181299.986817:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181299.986848:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408334848:12345-0@lo:13: Request processed in 53us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181299.986853:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789181299.986900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408333696 00000100:00100000:0.0:1789181299.986905:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408333696 00000100:00100000:0.0:1789181299.986932:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789181299.986938:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:3646:x1876092408333696:12345-0@lo:400: 00010000:00080000:2.0:1789181299.986942:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc255ad80 x1876092408333824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181299.986956:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408333824:0@lo:400: 00010000:00080000:2.0:1789181299.986968:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2559c00 x1876092408334336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181299.986969:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:3646:x1876092408333696:12345-0@lo:400: Request processed in 32us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181299.986975:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789181299.986977:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408334336:0@lo:400: 00010000:00080000:2.0:1789181299.986985:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc437b800 x1876092408334848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181299.986997:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408334848:0@lo:13: 00000100:00100000:2.0:1789181299.987006:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408333952:0@lo:400: 00010000:00080000:2.0:1789181299.987015:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2558e00 x1876092408334464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181299.987022:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408334464:0@lo:400: 00010000:00080000:2.0:1789181299.987143:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2559f80 x1876092408334080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181299.987159:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408334080:0@lo:400: 00010000:00080000:2.0:1789181299.987171:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc255b800 x1876092408334592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181299.987178:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408334592:0@lo:400: 00000100:00100000:2.0:1789181299.987187:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408333696:0@lo:400: 00000100:00100000:2.0:1789181299.987195:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408334208:0@lo:400: 00010000:00080000:2.0:1789181299.987205:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f65880 x1876092408334720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181299.987213:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408334720:0@lo:400: 00000100:00100000:1.0:1789181299.987230:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181299.987240:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408334976:0@lo:13: 00000100:00100000:1.0:1789181299.987285:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181299.987423:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408334976 00000100:00100000:2.0:1789181299.987428:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408334976 00000100:00100000:2.0:1789181299.987458:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789181299.987473:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408334976:12345-0@lo:13: 00002000:00000024:2.0:1789181299.987484:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181299.987514:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408334976:12345-0@lo:13: Request processed in 42us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181299.987520:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789181299.987648:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181299.987652:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181299.987654:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789181299.987668:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2756a00 x1876092408334976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181299.987677:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408334976:0@lo:13: 00010000:00010000:0.0:1789181300.235850:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181301.016986:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181301.020519:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408335104:0@lo:41: 00000100:00100000:2.0:1789181301.020631:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181301.020735:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408335104 00000100:00100000:2.0:1789181301.020745:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408335104 00000100:00100000:2.0:1789181301.020806:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789181301.020816:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408335104:12345-0@lo:41: 00000004:00000024:2.0:1789181301.020865:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789181301.020916:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408335104:12345-0@lo:41: Request processed in 101us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181301.020924:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789181301.020974:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408335104:0@lo:41: 00010000:00010000:1.0:1789181301.259835:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789181301.745381:0:9515:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789181301.745386:0:9515:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789181301.745387:0:9515:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789181301.745528:0:9515:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c1cc2475000 00000020:01000004:2.0:1789181301.745545:0:9515:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789181301.745559:0:9515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789181301.745572:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c1de7f219c0) 00000020:00000080:2.0:1789181301.745588:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789181301.782385:0:9515:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789181301.782445:0:9515:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789181301.817640:0:9515:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789181301.817870:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789181301.817884:0:9515:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789181301.817896:0:9515:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x76fb555283516e4b 00000020:01000004:2.0:1789181301.817904:0:9515:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789181301.817928:0:9515:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789181301.817932:0:9515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789181301.817938:0:9515:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789181301.817964:0:9515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789181301.817969:0:9515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789181301.890690:0:9515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789181301.890940:0:9515:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789181301.890945:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789181301.890947:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789181301.890948:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181301.890950:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181301.890951:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181301.890958:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181301.890959:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181301.890960:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789181301.890962:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789181301.890963:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181301.890965:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789181301.890969:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789181301.890971:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789181301.890972:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789181301.890973:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181301.890974:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181301.890975:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181301.890975:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181301.890976:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181301.890977:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789181301.890978:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789181301.890979:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181301.890980:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789181301.891010:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789181301.891031:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408335232:0@lo:253: 00000100:00100000:3.0:1789181301.891105:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181301.891188:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181301.893332:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408335232 00000100:00100000:1.0:1789181301.893346:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408335232 00000100:00100000:0.0:1789181301.896532:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789181301.896547:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:9515:x1876092408335232:12345-0@lo:253: 20000000:01000000:0.0:1789181301.896586:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789181301.896591:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789181301.896596:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789181301.896599:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789181301.896917:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181301.897060:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789181301.897076:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789181301.897096:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789181301.897103:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789181301.897116:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789181301.897132:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789181301.897223:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789181301.897261:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:0.0:1789181301.897263:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:0.0:1789181301.897281:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789181301.897288:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789181301.897303:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789181301.897318:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:0.0:1789181301.897334:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789181301.897341:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789181301.897354:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789181301.897371:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789181301.897443:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789181301.897455:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:0.0:1789181301.897456:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:0.0:1789181301.897470:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789181301.897476:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789181301.897489:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789181301.897494:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:0.0:1789181301.897507:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789181301.897512:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789181301.897524:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789181301.897539:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1789181301.897928:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789181301.897940:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.101@tcp 20000000:01000000:0.0:1789181301.897942:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.101@tcp (null) (null) (null) 00000040:00080000:0.0:1789181301.897956:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789181301.897961:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789181301.897974:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789181301.897980:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.101@tcp (null) (null) 00000040:00080000:0.0:1789181301.897994:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789181301.898000:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789181301.898012:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789181301.898027:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789181301.898041:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789181301.898044:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789181301.898047:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789181301.898090:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789181301.898100:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789181301.903284:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789181301.903348:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789181301.903359:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789181301.908008:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789181301.908048:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789181301.908066:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789181301.908077:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789181301.908079:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789181301.908519:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1789181301.908543:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1789181301.908558:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1789181301.908781:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1789181301.908801:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1789181301.908825:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1789181301.908833:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789181301.908835:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789181301.909113:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1789181301.909130:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1789181301.909143:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1789181301.909280:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1789181301.909299:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1789181301.909312:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1789181301.909320:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789181301.909321:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789181301.909593:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1789181301.909610:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1789181301.909624:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1789181301.909843:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1789181301.909860:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1789181301.909871:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1789181301.909880:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789181301.909881:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789181301.910139:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1789181301.910277:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1789181301.910298:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1789181301.910314:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:2.0:1789181301.910329:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789181301.910350:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910368:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e021f0800/0x76fb555283516d48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516d41 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910375:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1679600/0x76fb555283516d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516d6b expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910381:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516db1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516daa expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910388:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658b400/0x76fb555283516dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516dc6 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910396:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1679a00/0x76fb555283516df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516df0 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910410:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1522800/0x76fb555283516e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e0c expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910416:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e021f1a00/0x76fb555283516e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e36 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910424:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910634:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e021f1a00/0x76fb555283516e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516e36 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910650:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1e021f1a00/0x76fb555283516e3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516e36 expref: 21 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.910666:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408335360:0@lo:104: 00000100:00100000:2.0:1789181301.910886:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181301.910973:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1522800/0x76fb555283516e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516e0c expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.910982:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1522800/0x76fb555283516e13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516e0c expref: 21 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.910990:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408335488:0@lo:104: 00000100:00100000:2.0:1789181301.911014:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181301.912880:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1679a00/0x76fb555283516df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516df0 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.912898:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1679a00/0x76fb555283516df7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516df0 expref: 21 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.912928:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408335616:0@lo:104: 00000100:00100000:2.0:1789181301.912980:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181301.913005:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408335360 00000100:00100000:0.0:1789181301.913013:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408335360 00000100:00100000:0.0:1789181301.913055:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408335488 00000100:00100000:0.0:1789181301.913058:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408335488 00000100:00100000:0.0:1789181301.913074:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789181301.913083:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+4:6513:x1876092408335360:12345-0@lo:104: 00010000:00010000:0.0:1789181301.913097:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.913165:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181301.913171:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+4:6513:x1876092408335360:12345-0@lo:104: Request processed in 89us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181301.913177:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789181301.913197:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789181301.913203:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+3:6513:x1876092408335488:12345-0@lo:104: 00010000:00010000:0.0:1789181301.913212:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.913272:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789181301.913278:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+3:6513:x1876092408335488:12345-0@lo:104: Request processed in 75us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181301.913284:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789181301.913409:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181301.913417:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913448:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:1.0:1789181301.913453:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913460:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181301.913467:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181301.913473:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789181301.913514:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913521:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181301.913540:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913547:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679200/0x76fb555283516e36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e3d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913558:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181301.913562:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913567:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:1.0:1789181301.913570:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913586:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181301.913593:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181301.913598:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789181301.913611:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913617:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181301.913631:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913638:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522200/0x76fb555283516e0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913648:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181301.913649:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181301.913651:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181301.913663:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408335744:0@lo:103: 00000100:00100000:1.0:1789181301.913692:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181301.913753:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408335872:0@lo:103: 00000100:00100000:1.0:1789181301.913775:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181301.913802:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408335744 00000100:00100000:1.0:1789181301.913806:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408335744 00010000:00010000:1.0:1789181301.913825:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e021f1a00/0x76fb555283516e3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516e36 expref: 22 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181301.913854:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408335872 00000100:00100000:1.0:1789181301.913857:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408335872 00010000:00010000:1.0:1789181301.913868:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1522800/0x76fb555283516e13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516e0c expref: 23 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181301.913882:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181301.913888:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2757480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+23:3646:x1876092408335744:12345-0@lo:103: 00010000:00010000:1.0:1789181301.913898:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181301.913902:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e021f1a00/0x76fb555283516e3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516e36 expref: 23 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913913:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e021f1a00/0x76fb555283516e3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516e36 expref: 23 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.913929:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181301.913955:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2757480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+23:3646:x1876092408335744:12345-0@lo:103: Request processed in 66us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181301.913962:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181301.913975:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789181301.913981:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+22:3643:x1876092408335872:12345-0@lo:103: 00010000:00010000:1.0:1789181301.913988:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181301.913993:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1522800/0x76fb555283516e13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516e0c expref: 22 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.914002:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1522800/0x76fb555283516e13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516e0c expref: 22 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.914012:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181301.914044:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+22:3643:x1876092408335872:12345-0@lo:103: Request processed in 64us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181301.914050:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789181301.914094:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408335872:0@lo:103: 00000100:00100000:1.0:1789181301.914119:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408335744:0@lo:103: 00010000:00010000:2.0:1789181301.928331:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658b400/0x76fb555283516dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516dc6 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.928352:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc658b400/0x76fb555283516dcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516dc6 expref: 21 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.928368:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2559f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408336000:0@lo:104: 00000100:00100000:2.0:1789181301.928438:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181301.929467:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181301.931081:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516daa expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.931100:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516daa expref: 21 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.931114:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2559880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408336128:0@lo:104: 00000100:00100000:2.0:1789181301.931164:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181301.935076:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408335616 00000100:00100000:1.0:1789181301.935093:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408335616 00000100:00100000:1.0:1789181301.935159:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408336000 00000100:00100000:1.0:1789181301.935162:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408336000 00000100:00100000:1.0:1789181301.935181:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789181301.935190:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+4:6513:x1876092408335616:12345-0@lo:104: 00010000:00010000:1.0:1789181301.935209:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.935607:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789181301.935615:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+4:6513:x1876092408335616:12345-0@lo:104: Request processed in 426us (22635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181301.935622:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789181301.935643:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789181301.935650:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2558e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+3:6513:x1876092408336000:12345-0@lo:104: 00010000:00010000:1.0:1789181301.935659:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.935789:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1679600/0x76fb555283516d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516d6b expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.935804:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1679600/0x76fb555283516d72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516d6b expref: 21 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.935817:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408336256:0@lo:104: 00000100:00100000:2.0:1789181301.935850:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181301.935889:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e021f0800/0x76fb555283516d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516d41 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.935906:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1e021f0800/0x76fb555283516d48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516d41 expref: 21 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.935914:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408336384:0@lo:104: 00000100:00100000:2.0:1789181301.935934:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb284180 going to sleep for 11 seconds 00010000:00010000:2.0:1789181301.935954:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f1a00/0x76fb555283516e3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516e36 expref: 21 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.935968:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408335360:0@lo:104: 00010000:00010000:2.0:1789181301.935979:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1522800/0x76fb555283516e13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516e0c expref: 20 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.935987:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408335488:0@lo:104: 00000100:00100000:2.0:1789181301.935993:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408335616:0@lo:104: 00000100:00100000:2.0:1789181301.936000:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2559f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408336000:0@lo:104: 00000100:00100000:3.0:1789181301.939809:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408336128 00000100:00100000:3.0:1789181301.939825:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408336128 00000100:00100000:3.0:1789181301.939910:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789181301.939955:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181301.939977:0:6503:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789181301.939984:0:6503:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1789181301.940473:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789181301.940487:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.940509:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522c00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:0.0:1789181301.940514:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.940524:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181301.940531:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181301.940537:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181301.940593:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.940600:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181301.940620:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.940628:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283516df0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516df7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.940641:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181301.940644:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.940650:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0600 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:0.0:1789181301.940652:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.940669:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181301.940675:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181301.940679:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181301.940692:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.940697:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181301.940710:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.940715:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0600/0x76fb555283516dc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516dcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.940745:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181301.940747:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181301.940749:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181301.940765:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408336512:0@lo:103: 00000100:00100000:0.0:1789181301.940816:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181301.940867:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408336640:0@lo:103: 00000100:00100000:0.0:1789181301.940894:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181301.940928:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408336512 00000100:00100000:0.0:1789181301.940934:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408336512 00010000:00010000:0.0:1789181301.940958:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1679a00/0x76fb555283516df7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516df0 expref: 20 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181301.940994:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408336640 00000100:00100000:0.0:1789181301.940997:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408336640 00010000:00010000:0.0:1789181301.941011:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658b400/0x76fb555283516dcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516dc6 expref: 21 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181301.941030:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789181301.941039:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+21:3644:x1876092408336512:12345-0@lo:103: 00010000:00010000:0.0:1789181301.941052:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181301.941057:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1679a00/0x76fb555283516df7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516df0 expref: 21 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.941068:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1679a00/0x76fb555283516df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516df0 expref: 21 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.941083:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1679a00/0x76fb555283516df7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516df0 expref: 21 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.941097:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181301.941132:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+20:3644:x1876092408336512:12345-0@lo:103: Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181301.941138:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789181301.941154:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181301.941159:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+19:3645:x1876092408336640:12345-0@lo:103: 00010000:00010000:0.0:1789181301.941165:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181301.941169:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc658b400/0x76fb555283516dcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516dc6 expref: 19 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.941177:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658b400/0x76fb555283516dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516dc6 expref: 19 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.941195:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658b400/0x76fb555283516dcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516dc6 expref: 19 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.941203:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181301.941609:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408336256 00000100:00100000:2.0:1789181301.941615:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408336256 00000100:00100000:2.0:1789181301.941641:0:6503:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789181301.941648:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408336384 00000100:00100000:2.0:1789181301.941651:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408336384 00000100:00100000:0.0:1789181301.942354:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+18:3645:x1876092408336640:12345-0@lo:103: Request processed in 1190us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181301.942364:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181301.942556:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408336512:0@lo:103: 00000100:00100000:3.0:1789181301.942891:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789181301.942903:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2559c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:da575344-f445-48a7-8532-0e6efd2ea878+6:6513:x1876092408336128:12345-0@lo:104: 00010000:00010000:3.0:1789181301.942919:0:9526:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.943014:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789181301.943023:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2558e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+6:6513:x1876092408336000:12345-0@lo:104: Request processed in 7373us (14594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181301.943030:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789181301.943060:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181301.943068:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc26f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+5:6513:x1876092408336256:12345-0@lo:104: 00010000:00010000:1.0:1789181301.943077:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.943205:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181301.959391:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408336640:0@lo:103: 00010000:00010000:3.0:1789181301.960081:0:9526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181301.960092:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2559c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:da575344-f445-48a7-8532-0e6efd2ea878+5:6513:x1876092408336128:12345-0@lo:104: Request processed in 17190us (28926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181301.960116:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789181301.960152:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789181301.960163:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:da575344-f445-48a7-8532-0e6efd2ea878+4:6513:x1876092408336384:12345-0@lo:104: 00010000:00010000:3.0:1789181301.960181:0:9526:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.960243:0:9526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789181301.960260:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:da575344-f445-48a7-8532-0e6efd2ea878+4:6513:x1876092408336384:12345-0@lo:104: Request processed in 91us (20297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181301.960268:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789181301.960450:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2559880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408336128:0@lo:104: 00000100:00100000:2.0:1789181301.960461:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408336384:0@lo:104: 00010000:00010000:2.0:1789181301.962367:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181301.962383:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962416:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678a00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181301.962421:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962431:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181301.962439:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181301.962444:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181301.962499:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962513:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181301.962533:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962541:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678a00/0x76fb555283516daa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516db1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962557:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181301.962561:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962568:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522400 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181301.962571:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181301.962582:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789181301.962596:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc26f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+3:6513:x1876092408336256:12345-0@lo:104: Request processed in 19524us (26740us total) trans 0 rc 0/0 00010000:00010000:2.0:1789181301.962601:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181301.962609:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 10000000:00010000:2.0:1789181301.962612:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181301.962620:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181301.962643:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962649:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181301.962664:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962671:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283516d41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d48 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962683:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181301.962687:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962693:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658ba00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181301.962695:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962702:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181301.962713:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181301.962744:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181301.962761:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962767:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181301.962779:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962786:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb555283516d6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d72 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181301.962790:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408337024:0@lo:103: 00010000:00010000:2.0:1789181301.962806:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181301.962809:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181301.962811:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181301.962827:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181301.962841:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408336768:0@lo:103: 00000100:00100000:0.0:1789181301.962842:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181301.962877:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181301.962905:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408336896:0@lo:103: 00000100:00100000:0.0:1789181301.962919:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408337024 00000100:00100000:2.0:1789181301.962923:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181301.962929:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408337024 00010000:00010000:2.0:1789181301.962944:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181301.962954:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408336768 00000100:00100000:2.0:1789181301.962957:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408336768 00010000:00010000:0.0:1789181301.962962:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1679600/0x76fb555283516d72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516d6b expref: 18 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.962974:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516daa expref: 19 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.962988:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408336896 00000100:00100000:2.0:1789181301.962990:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408336896 00000100:00100000:0.0:1789181301.962996:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789181301.962999:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e021f0800/0x76fb555283516d48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516d41 expref: 20 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181301.963009:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+20:3644:x1876092408337024:12345-0@lo:103: 00000100:00100000:2.0:1789181301.963024:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1789181301.963027:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789181301.963031:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+20:3645:x1876092408336768:12345-0@lo:103: 00010000:00010000:0.0:1789181301.963035:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1679600/0x76fb555283516d72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516d6b expref: 20 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.963040:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181301.963047:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516daa expref: 20 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.963051:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1679600/0x76fb555283516d72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516d6b expref: 20 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.963269:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516daa expref: 20 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.963286:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516db1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516daa expref: 20 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.963301:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181301.963336:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+19:3645:x1876092408336768:12345-0@lo:103: Request processed in 306us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181301.963343:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789181301.963357:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789181301.963362:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+18:3643:x1876092408336896:12345-0@lo:103: 00010000:00010000:2.0:1789181301.963369:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181301.963373:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e021f0800/0x76fb555283516d48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516d41 expref: 18 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.963382:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e021f0800/0x76fb555283516d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516d41 expref: 18 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.963392:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f0800/0x76fb555283516d48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516d41 expref: 18 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.963411:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181301.963436:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+17:3643:x1876092408336896:12345-0@lo:103: Request processed in 74us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181301.963443:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789181301.963478:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408336768:0@lo:103: 00000100:00100000:2.0:1789181301.963498:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408336896:0@lo:103: 00000100:00100000:3.0:1789181301.965191:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1876092408336256:0@lo:104: 00010000:00010000:3.0:1789181301.965245:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965663:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1679600/0x76fb555283516d72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516d6b expref: 16 pid: 6515 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965701:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965711:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965755:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965763:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965769:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965776:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965782:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1523c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181301.965786:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965795:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965812:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.965822:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181301.965905:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+15:3644:x1876092408337024:12345-0@lo:103: Request processed in 2899us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181301.965924:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789181301.965931:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408337024:0@lo:103: 00010000:00010000:3.0:1789181301.966404:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.966413:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.966419:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516e52 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789181301.966450:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789181301.969376:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+14:9515:x1876092408335232:12345-0@lo:253: Request processed in 72821us (78260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181301.969391:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789181301.969621:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408335232:0@lo:253: 10000000:01000000:3.0:1789181301.969640:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789181301.969644:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789181301.969646:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789181301.969661:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181301.969662:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789181301.969663:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181301.969665:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181301.969666:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181301.969667:0:9515:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789181301.969669:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181301.969671:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789181301.969693:0:9515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c1cc2475000 from lustre-OST0001 10000000:01000000:3.0:1789181301.969854:0:9515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789181301.969858:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789181301.969868:0:9515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c1dd13ecd40 local copy 10000000:01000000:3.0:1789181301.969873:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789181301.970111:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.970122:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.970131:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181301.970149:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337152:0@lo:101: 00000100:00100000:3.0:1789181301.970196:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181301.970342:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181301.971138:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408337152 00000100:00100000:0.0:1789181301.971149:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408337152 00000100:00100000:0.0:1789181301.971766:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789181301.971780:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+14:9515:x1876092408337152:12345-0@lo:101: 00010000:00010000:0.0:1789181301.971797:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181301.971815:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516e59 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.971840:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516e59 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.971851:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e59 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181301.971859:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b400, rc 0) 00000100:00100000:0.0:1789181301.971933:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408337152:12345-0@lo:101: Request processed in 157us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181301.971939:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789181301.972039:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337152:0@lo:101: 00010000:00010000:3.0:1789181301.972054:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.972064:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181301.972169:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337280:0@lo:501: 00000100:00100000:3.0:1789181301.972225:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181301.985089:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181301.985869:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408337280 00000100:00100000:2.0:1789181301.989167:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408337280 00000100:00100000:3.0:1789181301.991208:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789181301.991228:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408337280:12345-0@lo:501: 00000100:00100000:3.0:1789181301.991401:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408337280:12345-0@lo:501: Request processed in 177us (19186us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789181301.991410:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789181301.995333:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337280:0@lo:501: 10000000:01000000:2.0:1789181301.995372:0:9515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789181301.995446:0:9515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789181301.995456:0:9515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.995467:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.995474:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.995503:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789181301.995560:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c1cc2475000 10000000:01000000:2.0:1789181301.995565:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789181301.995572:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789181301.995575:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789181301.995579:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789181301.995583:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789181301.995621:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.995630:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.995642:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.995662:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337408:0@lo:101: 00000100:00100000:2.0:1789181301.995751:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181301.995785:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb284d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181301.995816:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408337408 00000100:00100000:2.0:1789181301.995824:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408337408 00000100:00100000:2.0:1789181301.995869:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789181301.996371:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408337408:12345-0@lo:101: 00010000:00010000:2.0:1789181301.996389:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181301.996404:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516e6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516e67 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.996440:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516e6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516e67 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.996452:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516e6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e67 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.996470:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523a00, rc 0) 00000100:00100000:2.0:1789181301.996526:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408337408:12345-0@lo:101: Request processed in 163us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181301.996532:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789181301.996587:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337408:0@lo:101: 00010000:00010000:2.0:1789181301.996602:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181301.996610:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181301.996697:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337536:0@lo:501: 00000100:00100000:2.0:1789181301.996755:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181301.996771:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb284d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181301.996784:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408337536 00000100:00100000:2.0:1789181301.996788:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408337536 00000100:00100000:2.0:1789181301.996807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789181301.996812:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408337536:12345-0@lo:501: 00010000:00010000:3.0:1789181301.996991:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181301.996998:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.997006:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e00866a00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181301.997020:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.997030:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181301.997037:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181301.997043:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181301.997063:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.997068:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181301.997084:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.997101:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x76fb555283516e60 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181301.997121:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181301.997122:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181301.997124:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181302.000225:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408337536:12345-0@lo:501: Request processed in 3401us (3458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.000241:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789181302.000324:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408337664:0@lo:103: 00000100:00100000:2.0:1789181302.000360:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.000414:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408337664 00000100:00100000:2.0:1789181302.000423:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408337664 00000100:00100000:2.0:1789181302.000470:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181302.000495:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+16:3645:x1876092408337664:12345-0@lo:103: 00010000:00010000:2.0:1789181302.000509:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181302.000531:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283516e59 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181302.000548:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181302.000576:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+15:3645:x1876092408337664:12345-0@lo:103: Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.000583:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181302.000619:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408337664:0@lo:103: 00000100:00100000:3.0:1789181302.002043:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337536:0@lo:501: 00000100:00100000:3.0:1789181302.002104:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337792:0@lo:503: 00000100:00100000:3.0:1789181302.002170:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181302.002196:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181302.002777:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408337792 00000100:00100000:0.0:1789181302.002786:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408337792 00000100:00100000:0.0:1789181302.002833:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789181302.002842:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408337792:12345-0@lo:503: 00000100:00100000:0.0:1789181302.002975:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408337792:12345-0@lo:503: Request processed in 133us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181302.002983:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789181302.003116:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337792:0@lo:503: 00000040:00080000:3.0:1789181302.003391:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181302.003472:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337920:0@lo:502: 00000100:00100000:3.0:1789181302.003517:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181302.003543:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd2a98e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181302.003748:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408337920 00000100:00100000:0.0:1789181302.003755:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408337920 00000100:00100000:0.0:1789181302.003790:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789181302.003797:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408337920:12345-0@lo:502: 00000100:00100000:0.0:1789181302.003887:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408337920:12345-0@lo:502: Request processed in 89us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181302.003895:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789181302.003977:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408337920:0@lo:502: 00000040:00080000:3.0:1789181302.004285:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789181302.004313:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789181302.004327:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789181302.004339:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789181302.004351:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789181302.004363:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789181302.004384:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338048:0@lo:502: 00000100:00100000:3.0:1789181302.004421:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181302.004512:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181302.005409:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408338048 00000100:00100000:1.0:1789181302.005419:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408338048 00000100:00100000:0.0:1789181302.008245:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789181302.008283:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408338048:12345-0@lo:502: 00000100:00100000:0.0:1789181302.008480:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408338048:12345-0@lo:502: Request processed in 208us (4057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181302.008488:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789181302.008678:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338048:0@lo:502: 00000040:00080000:3.0:1789181302.008780:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789181302.008792:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1789181302.009452:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789181302.009461:0:9527:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789181302.009478:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181302.009480:0:9527:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789181302.009488:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789181302.009511:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c1cc3260000) 00000020:00000080:3.0:1789181302.009544:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789181302.009552:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789181302.009632:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1cc2475000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789181302.009641:0:9527:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789181302.009647:0:9527:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x76fb555283516e7c 00010000:00010000:3.0:1789181302.020715:0:9527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1789181302.021053:0:9527:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789181302.036474:0:9527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789181302.046508:0:9527:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789181302.061490:0:9527:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789181302.061696:0:9527:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789181302.077408:0:9527:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789181302.084338:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789181302.084353:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181302.084359:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181302.084361:0:9527:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789181302.084365:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181302.084370:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181302.084371:0:9527:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789181302.084374:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789181302.084376:0:9527:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789181302.084403:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181302.084406:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181302.084407:0:9527:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789181302.084411:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789181302.084657:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789181302.084688:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789181302.084714:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.084756:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181302.084766:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1cc2475000 from 1 10000000:01000000:3.0:1789181302.084769:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181302.084807:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.084816:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.084828:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181302.084870:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338176:0@lo:101: 00000100:00100000:3.0:1789181302.084958:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181302.085001:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f84300 going to sleep for 11 seconds 00000100:00100000:2.0:1789181302.087038:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408338176 00000100:00100000:2.0:1789181302.087057:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408338176 00000100:00100000:2.0:1789181302.087124:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789181302.087138:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408338176:12345-0@lo:101: 00010000:00010000:2.0:1789181302.087158:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181302.087179:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516e8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516e83 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181302.087209:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516e83 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181302.087219:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e83 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181302.087240:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522a00, rc 0) 00000100:00100000:2.0:1789181302.087335:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408338176:12345-0@lo:101: Request processed in 200us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.087341:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789181302.089116:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338176:0@lo:101: 00010000:00010000:3.0:1789181302.089144:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.089156:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181302.089285:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338304:0@lo:501: 00000100:00100000:3.0:1789181302.089337:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181302.089383:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f84300 going to sleep for 11 seconds 00000100:00100000:1.0:1789181302.089514:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408338304 00000100:00100000:1.0:1789181302.089520:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408338304 00000100:00100000:1.0:1789181302.089573:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789181302.089583:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408338304:12345-0@lo:501: 00000100:00100000:1.0:1789181302.090206:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408338304:12345-0@lo:501: Request processed in 623us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181302.090284:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789181302.090340:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338304:0@lo:501: 00000100:00100000:1.0:1789181302.090372:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338432:0@lo:503: 00000100:00100000:1.0:1789181302.090413:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181302.090428:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27a36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181302.090748:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408338432 00000100:00100000:3.0:1789181302.090753:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408338432 00000100:00100000:3.0:1789181302.090789:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789181302.090797:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408338432:12345-0@lo:503: 00000100:00100000:3.0:1789181302.090935:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408338432:12345-0@lo:503: Request processed in 138us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181302.090942:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789181302.092976:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338432:0@lo:503: 00000040:00080000:3.0:1789181302.093555:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181302.095389:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338560:0@lo:502: 00000100:00100000:3.0:1789181302.095479:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181302.096247:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f84540 going to sleep for 11 seconds 00000100:00100000:2.0:1789181302.097408:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408338560 00000100:00100000:2.0:1789181302.097422:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408338560 00000100:00100000:2.0:1789181302.097474:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789181302.097484:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408338560:12345-0@lo:502: 00000100:00100000:2.0:1789181302.097658:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408338560:12345-0@lo:502: Request processed in 174us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.097666:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789181302.100332:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338560:0@lo:502: 00000040:00080000:3.0:1789181302.100555:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789181302.100581:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789181302.100613:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338688:0@lo:502: 00000100:00100000:3.0:1789181302.100688:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181302.100757:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f84540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181302.100841:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408338688 00000100:00100000:0.0:1789181302.100850:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408338688 00000100:00100000:0.0:1789181302.100908:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789181302.100917:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408338688:12345-0@lo:502: 00000100:00100000:0.0:1789181302.101037:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408338688:12345-0@lo:502: Request processed in 120us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181302.101044:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789181302.101212:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338688:0@lo:502: 00000040:00080000:1.0:1789181302.101275:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789181302.101284:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789181302.102049:0:9531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181302.102058:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181302.102060:0:9531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789181302.102066:0:9531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1cc2475000 00000020:00000080:1.0:1789181302.102069:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181302.102079:0:9531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181302.102081:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181302.102082:0:9531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789181302.102085:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789181302.102301:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789181302.102324:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181302.102342:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.102354:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181302.102400:0:9515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789181302.102402:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c1cc2475000 10000000:01000000:3.0:1789181302.102405:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c1cc2475000 10000000:01000000:3.0:1789181302.102408:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789181302.102413:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1cc2475000 from 1 10000000:01000000:3.0:1789181302.102415:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789181302.102441:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.102449:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.102460:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181302.102476:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338816:0@lo:101: 00000100:00100000:3.0:1789181302.102524:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181302.102561:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f84840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181302.102615:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408338816 00000100:00100000:0.0:1789181302.102629:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408338816 00000100:00100000:0.0:1789181302.102667:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789181302.102675:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:9515:x1876092408338816:12345-0@lo:101: 00010000:00010000:0.0:1789181302.102685:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181302.102696:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516e91 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181302.102715:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516e91 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181302.102763:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e91 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181302.102771:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b400, rc 0) 00000100:00100000:0.0:1789181302.102806:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:9515:x1876092408338816:12345-0@lo:101: Request processed in 132us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181302.102812:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789181302.102847:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338816:0@lo:101: 00010000:00010000:0.0:1789181302.102858:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181302.102865:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181302.119041:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338944:0@lo:501: 00000100:00100000:2.0:1789181302.119113:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.119166:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181302.119243:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408338944 00000100:00100000:0.0:1789181302.119261:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408338944 00000100:00100000:0.0:1789181302.119316:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789181302.119326:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:9515:x1876092408338944:12345-0@lo:501: 00000100:00100000:0.0:1789181302.119457:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:9515:x1876092408338944:12345-0@lo:501: Request processed in 131us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181302.119465:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789181302.120000:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408338944:0@lo:501: 00000100:00100000:2.0:1789181302.120049:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408339072:0@lo:503: 00000100:00100000:2.0:1789181302.120103:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.120127:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181302.120228:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408339072 00000100:00100000:0.0:1789181302.120234:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408339072 00000100:00100000:0.0:1789181302.120281:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789181302.120289:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:9515:x1876092408339072:12345-0@lo:503: 00000100:00100000:0.0:1789181302.120387:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:9515:x1876092408339072:12345-0@lo:503: Request processed in 98us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181302.120401:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789181302.120706:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408339072:0@lo:503: 00000040:00080000:2.0:1789181302.121036:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789181302.121103:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408339200:0@lo:502: 00000100:00100000:2.0:1789181302.121145:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.121172:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181302.121244:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408339200 00000100:00100000:1.0:1789181302.121260:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408339200 00000100:00100000:1.0:1789181302.121289:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789181302.121297:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:9515:x1876092408339200:12345-0@lo:502: 00000100:00100000:1.0:1789181302.121390:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:9515:x1876092408339200:12345-0@lo:502: Request processed in 94us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181302.121397:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789181302.122210:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408339200:0@lo:502: 00000040:00080000:2.0:1789181302.122471:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789181302.122498:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789181302.122510:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789181302.122520:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789181302.122530:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789181302.122539:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789181302.122549:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789181302.122561:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789181302.122591:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789181302.122605:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789181302.122630:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789181302.122648:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789181302.122662:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789181302.122675:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789181302.122687:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789181302.122700:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789181302.122713:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789181302.122758:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789181302.122774:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789181302.122787:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789181302.122799:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789181302.122811:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789181302.122823:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789181302.122838:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789181302.122866:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789181302.122894:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789181302.122909:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789181302.122922:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789181302.122933:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789181302.122945:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789181302.122958:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789181302.122972:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789181302.122995:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789181302.124604:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789181302.124667:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789181302.124685:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789181302.124698:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1789181302.124713:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789181302.125366:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1789181302.125390:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1789181302.125447:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1789181302.125464:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1789181302.125476:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1789181302.125489:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1789181302.125502:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1789181302.125515:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1789181302.125598:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408339328:0@lo:502: 00000100:00100000:2.0:1789181302.125686:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.125760:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181302.125926:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408339328 00000100:00100000:1.0:1789181302.125934:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408339328 00000100:00100000:1.0:1789181302.125986:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789181302.125995:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:9515:x1876092408339328:12345-0@lo:502: 00000100:00100000:1.0:1789181302.126134:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:9515:x1876092408339328:12345-0@lo:502: Request processed in 139us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181302.126148:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789181302.131806:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408339328:0@lo:502: 00000040:00080000:2.0:1789181302.131936:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1789181302.131953:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1789181302.137024:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789181302.137045:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c1e00954d40) 00000020:00000080:1.0:1789181302.137071:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1789181302.137146:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1cc2475000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789181302.137151:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1cc2475000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789181302.137153:0:9532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1cc2475000 3 00010000:00080000:1.0:1789181302.137184:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1e00841800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1789181302.142420:0:9532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1789181302.144377:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789181302.144428:0:9532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789181302.144441:0:9532:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x76fb555283516ea6 00000100:00080000:1.0:1789181302.144451:0:9532:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181302.144463:0:9532:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c1e00841800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181302.144499:0:9532:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc2754380 x1876092408339456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789181302.145027:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876092408339456:0@lo:38: 00000100:00100000:0.0:1789181302.145099:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789181302.145193:0:9532:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789181302.146041:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408339456 00000100:00100000:3.0:1789181302.146060:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408339456 00000100:00100000:3.0:1789181302.146104:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181302.146112:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876092408339456:12345-0@lo:38: 00010000:00080000:3.0:1789181302.146139:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:3.0:1789181302.146813:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x76fb555283516ead 00000004:00100000:3.0:1789181302.146832:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789181302.146866:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9c1cc326d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181302.158424:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408339584:0@lo:400: 00000100:00100000:2.0:1789181302.158820:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.158868:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408340096:0@lo:400: 00000100:00100000:2.0:1789181302.162445:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.162516:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789181302.162532:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408339968:0@lo:400: 00000100:00100000:2.0:1789181302.162562:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.162584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408340480:0@lo:400: 00000100:00100000:2.0:1789181302.162604:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.162660:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408339712:0@lo:400: 00000100:00100000:2.0:1789181302.162684:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.162702:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408340224:0@lo:400: 00000100:00100000:2.0:1789181302.162741:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.162757:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789181302.162763:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408339840:0@lo:400: 00000100:00100000:2.0:1789181302.162781:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.162791:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408340352:0@lo:400: 00000100:00100000:2.0:1789181302.162810:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.162842:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408339584 00000100:00100000:2.0:1789181302.162850:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408339584 00000100:00100000:2.0:1789181302.162888:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408340096 00000100:00100000:2.0:1789181302.162891:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408340096 00000100:00100000:2.0:1789181302.162915:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408340224 00000100:00100000:2.0:1789181302.162918:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408340224 00000100:00100000:2.0:1789181302.162939:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408339840 00000100:00100000:2.0:1789181302.162941:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408339840 00000100:00100000:2.0:1789181302.162955:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789181302.162964:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408339584:12345-0@lo:400: 00000100:00100000:2.0:1789181302.163033:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408339584:12345-0@lo:400: Request processed in 69us (4212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.163041:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789181302.163059:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789181302.163066:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408340096:12345-0@lo:400: 00000100:00100000:2.0:1789181302.163092:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408340096:12345-0@lo:400: Request processed in 28us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.163098:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789181302.163109:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789181302.163123:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408340224:12345-0@lo:400: 00000100:00100000:2.0:1789181302.163154:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408340224:12345-0@lo:400: Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.163160:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789181302.163172:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789181302.163178:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408339840:12345-0@lo:400: 00000100:00100000:2.0:1789181302.163221:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408339840:12345-0@lo:400: Request processed in 42us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.163227:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789181302.164100:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408339968 00000100:00100000:2.0:1789181302.164108:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408339968 00000100:00100000:2.0:1789181302.164145:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408339712 00000100:00100000:2.0:1789181302.164147:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408339712 00000100:00100000:2.0:1789181302.164161:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789181302.164169:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408339968:12345-0@lo:400: 00000100:00100000:2.0:1789181302.164223:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408339968:12345-0@lo:400: Request processed in 54us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.164229:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789181302.164241:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181302.164247:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408339712:12345-0@lo:400: 00000100:00100000:2.0:1789181302.164288:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408339712:12345-0@lo:400: Request processed in 42us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.164294:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181302.164314:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408340480 00000100:00100000:2.0:1789181302.164318:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408340480 00000100:00100000:2.0:1789181302.164345:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408340352 00000100:00100000:2.0:1789181302.164348:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408340352 00000100:00100000:2.0:1789181302.164382:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789181302.164388:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408340480:12345-0@lo:400: 00000100:00100000:2.0:1789181302.164421:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408340480:12345-0@lo:400: Request processed in 33us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.164439:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789181302.164452:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181302.164458:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408340352:12345-0@lo:400: 00000100:00100000:2.0:1789181302.164484:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408340352:12345-0@lo:400: Request processed in 27us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.164489:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789181302.164512:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181302.164517:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181302.164520:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181302.164552:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408339968:0@lo:400: 00010000:00080000:2.0:1789181302.164567:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2754e00 x1876092408340480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181302.164577:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408340480:0@lo:400: 00010000:00080000:2.0:1789181302.164589:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2754000 x1876092408339584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181302.164597:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408339584:0@lo:400: 00010000:00080000:2.0:1789181302.164607:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2755f80 x1876092408340096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181302.164614:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408340096:0@lo:400: 00010000:00080000:2.0:1789181302.167024:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2756d80 x1876092408339840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181302.167075:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408339840:0@lo:400: 00010000:00080000:2.0:1789181302.167090:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2755c00 x1876092408340352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181302.167097:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408340352:0@lo:400: 00000100:00100000:2.0:1789181302.167107:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408339712:0@lo:400: 00010000:00080000:2.0:1789181302.167116:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2757b80 x1876092408340224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181302.167123:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408340224:0@lo:400: 00000100:00100000:3.0:1789181302.167297:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876092408339456:12345-0@lo:38: Request processed in 21182us (22195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181302.167308:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789181302.167428:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc2754380 x1876092408339456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181302.167436:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789181302.167445:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789181302.167453:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789181302.167458:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789181302.167461:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1e00841800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789181302.167467:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876092408339456:0@lo:38: 00000020:01000004:3.0:1789181302.171924:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789181302.171944:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c1cc3263380) 00000020:00000080:3.0:1789181302.171970:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1789181302.172092:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1cc2475000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789181302.172097:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1cc2475000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789181302.172099:0:9532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1cc2475000 3 00010000:00080000:3.0:1789181302.172130:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1cc326c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1789181302.173933:0:9532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1789181302.174120:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789181302.174164:0:9532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789181302.174179:0:9532:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x76fb555283516ebb 00000100:00080000:3.0:1789181302.174189:0:9532:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789181302.174200:0:9532:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c1cc326c000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181302.174235:0:9532:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1de7f64700 x1876092408340608/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789181302.174286:0:9532:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789181302.178169:0:9533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1876092408340736:0@lo:901: 00000100:00100000:2.0:1789181302.178246:0:9533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.178308:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408340736 00000100:00100000:2.0:1789181302.178315:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408340736 00000100:00100000:2.0:1789181302.178371:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181302.178380:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1876092408340736:12345-0@lo:901: 00000100:00100000:2.0:1789181302.178482:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1876092408340736:12345-0@lo:901: Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.178489:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789181302.178510:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181302.178532:0:9533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce6000 going to sleep for 11 seconds 00010000:00080000:2.0:1789181302.178554:0:9533:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc3208a80 x1876092408340736/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789181318 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181302.178568:0:9533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1876092408340736:0@lo:901: 00000100:00100000:1.0:1789181302.179468:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876092408340608:0@lo:38: 00000100:00100000:1.0:1789181302.179526:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.183949:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408340608 00000100:00100000:2.0:1789181302.183987:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408340608 00000100:00100000:2.0:1789181302.184040:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789181302.184049:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1876092408340608:12345-0@lo:38: 00010000:00080000:2.0:1789181302.184084:0:9021:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:2.0:1789181302.184124:0:9021:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x76fb555283516ec2 00000004:00100000:2.0:1789181302.184144:0:9021:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789181302.184185:0:9021:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d2d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181302.184300:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876092408340608:12345-0@lo:38: Request processed in 251us (4774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.184308:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789181302.186540:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7f64700 x1876092408340608/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181302.186558:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789181302.186569:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789181302.186578:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789181302.186584:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789181302.186588:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc326c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789181302.186611:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876092408340608:0@lo:38: 00000040:00080000:3.0:1789181302.186874:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1789181302.190571:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1789181302.190620:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181302.190642:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181302.190655:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789181302.190784:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789181302.190787:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789181302.190788:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181302.190789:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181302.190791:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181302.190792:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181302.190794:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181302.190796:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181302.190798:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181302.190800:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181302.190801:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181302.190806:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789181302.190808:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181302.190810:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789181302.190820:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181302.190821:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181302.190822:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181302.190823:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181302.190824:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181302.190825:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181302.190826:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181302.190827:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181302.190828:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181302.190876:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789181302.190895:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408340864:0@lo:253: 00000100:00100000:2.0:1789181302.190964:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181302.191001:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce6000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181302.192010:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408340864 00000100:00100000:3.0:1789181302.192021:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408340864 00000100:00100000:3.0:1789181302.192075:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789181302.192085:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:9515:x1876092408340864:12345-0@lo:253: 20000000:01000000:3.0:1789181302.192115:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789181302.192128:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789181302.200393:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789181302.201126:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789181302.206424:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789181302.206534:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789181302.207051:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.207071:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1523600/0x76fb555283516dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516db8 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.207078:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1523200/0x76fb555283516e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516dfe expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.207085:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.207130:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1523200/0x76fb555283516e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516dfe expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.207145:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1523200/0x76fb555283516e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516dfe expref: 17 pid: 6515 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181302.207158:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408340992:0@lo:104: 00000100:00100000:3.0:1789181302.207234:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181302.207305:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1523600/0x76fb555283516dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516db8 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181302.207314:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1523600/0x76fb555283516dbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516db8 expref: 17 pid: 6513 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181302.207323:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408341120:0@lo:104: 00000100:00100000:3.0:1789181302.207345:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181302.207372:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f846c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181302.207520:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408340992 00000100:00100000:1.0:1789181302.207529:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408340992 00000100:00100000:1.0:1789181302.207584:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408341120 00000100:00100000:1.0:1789181302.207587:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408341120 00000100:00100000:1.0:1789181302.207603:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181302.207612:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:da575344-f445-48a7-8532-0e6efd2ea878+4:6537:x1876092408340992:12345-0@lo:104: 00010000:00010000:1.0:1789181302.207635:0:9526:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.207692:0:9526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789181302.207699:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:da575344-f445-48a7-8532-0e6efd2ea878+4:6537:x1876092408340992:12345-0@lo:104: Request processed in 89us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181302.207706:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181302.207745:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181302.207752:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:da575344-f445-48a7-8532-0e6efd2ea878+3:6537:x1876092408341120:12345-0@lo:104: 00010000:00010000:1.0:1789181302.207761:0:9526:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.207795:0:9526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789181302.207801:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:da575344-f445-48a7-8532-0e6efd2ea878+3:6537:x1876092408341120:12345-0@lo:104: Request processed in 50us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181302.207817:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181302.207853:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408340992:0@lo:104: 00000100:00100000:1.0:1789181302.207862:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1876092408341120:0@lo:104: 00010000:00010000:1.0:1789181302.207880:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.207907:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181302.207914:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.207921:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522e00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:1.0:1789181302.207925:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.207934:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181302.207941:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181302.207948:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789181302.207975:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.207982:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181302.207998:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.208004:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522e00/0x76fb555283516dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.208758:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181302.208763:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.208781:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:1.0:1789181302.208784:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.208791:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181302.208797:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181302.208802:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789181302.208833:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.208839:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181302.208857:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.208863:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a200/0x76fb555283516db8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516dbf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.208875:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181302.208877:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181302.208879:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181302.209183:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181302.209199:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408341248:0@lo:103: 00000100:00100000:0.0:1789181302.209261:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181302.209313:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181302.209517:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408341248 00000100:00100000:1.0:1789181302.209524:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408341248 00010000:00010000:1.0:1789181302.209553:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1523200/0x76fb555283516e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516dfe expref: 18 pid: 6515 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181302.209590:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181302.209607:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+18:3645:x1876092408341248:12345-0@lo:103: 00010000:00010000:1.0:1789181302.209752:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181302.209759:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1523200/0x76fb555283516e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516dfe expref: 18 pid: 6515 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.209770:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1523200/0x76fb555283516e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516dfe expref: 18 pid: 6515 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.209786:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523200/0x76fb555283516e05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516dfe expref: 18 pid: 6515 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.209799:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181302.209954:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+17:3645:x1876092408341248:12345-0@lo:103: Request processed in 348us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181302.209961:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789181302.210039:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408341376:0@lo:103: 00000100:00100000:3.0:1789181302.210073:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181302.210196:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408341376 00000100:00100000:1.0:1789181302.210201:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408341376 00010000:00010000:1.0:1789181302.210217:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1523600/0x76fb555283516dbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516db8 expref: 17 pid: 6513 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181302.210244:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181302.210262:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+17:3643:x1876092408341376:12345-0@lo:103: 00010000:00010000:1.0:1789181302.210272:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181302.210276:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1523600/0x76fb555283516dbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516db8 expref: 17 pid: 6513 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210284:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1523600/0x76fb555283516dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516db8 expref: 17 pid: 6513 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210295:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523600/0x76fb555283516dbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516db8 expref: 17 pid: 6513 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210314:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210322:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789181302.210336:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012487745s 00010000:00010000:1.0:1789181302.210340:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210347:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210354:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210361:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210367:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e00866800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181302.210371:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210378:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210392:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210402:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181302.210451:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+16:3643:x1876092408341376:12345-0@lo:103: Request processed in 200us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181302.210458:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181302.210491:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408341376:0@lo:103: 00010000:00010000:1.0:1789181302.210513:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210521:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181302.210527:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e00866800/0x76fb555283516ec9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181302.210831:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:9515:x1876092408340864:12345-0@lo:253: Request processed in 18747us (19865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181302.210840:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789181302.211119:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da575344-f445-48a7-8532-0e6efd2ea878:9515:1876092408340864:0@lo:253: 10000000:01000000:3.0:1789181302.211131:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789181302.211134:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789181302.211136:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789181302.211137:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181302.211138:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181302.211140:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181302.211141:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181302.211143:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181302.211145:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789181302.211146:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789181302.211148:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181302.211149:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789181302.211161:0:9515:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789181302.214116:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408341248:0@lo:103: 00080000:10000000:2.0:1789181302.217988:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789181302.218263:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789181302.218547:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789181302.219094:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789181302.219340:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789181302.220217:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789181302.222388:0:9515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789181302.237104:0:9515:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789181302.237114:0:9515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789181302.237148:0:9515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789181302.237186:0:9515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789181302.237205:0:9515:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789181302.237226:0:9515:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789181302.245747:0:9515:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789181302.247236:0:9515:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789181302.293351:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181303.307957:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789181303.509899:0:9587:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181303.510559:0:9587:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789181303.563988:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408341504:0@lo:41: 00000100:00100000:3.0:1789181303.564091:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181303.564207:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408341504 00000100:00100000:2.0:1789181303.564216:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408341504 00000100:00100000:2.0:1789181303.564275:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181303.564285:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408341504:12345-0@lo:41: 00000004:00000024:2.0:1789181303.564333:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789181303.564379:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408341504:12345-0@lo:41: Request processed in 96us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181303.564385:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181303.564427:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408341504:0@lo:41: 00010000:00010000:3.0:1789181304.336858:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181305.101016:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181305.101045:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408341632:0@lo:13: 00000100:00100000:0.0:1789181305.101115:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181305.102923:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408341632 00000100:00100000:2.0:1789181305.102935:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408341632 00000100:00100000:2.0:1789181305.103001:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789181305.103011:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408341632:12345-0@lo:13: 00002000:00000024:2.0:1789181305.103041:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181305.103109:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408341632:12345-0@lo:13: Request processed in 101us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181305.103115:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789181305.103157:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc2757100 x1876092408341632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181305.103174:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408341632:0@lo:13: 00000100:00080000:3.0:1789181305.103298:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181305.104565:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181305.104582:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408341760:0@lo:13: 00000100:00100000:0.0:1789181305.104643:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181305.106846:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408341760 00000100:00100000:2.0:1789181305.106862:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408341760 00000100:00100000:2.0:1789181305.106953:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181305.106966:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408341760:12345-0@lo:13: 00002000:00000024:2.0:1789181305.106991:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181305.107073:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408341760:12345-0@lo:13: Request processed in 110us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181305.107080:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789181305.109890:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb57ca80 x1876092408341760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181305.109941:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408341760:0@lo:13: 00000100:00080000:3.0:1789181305.110153:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789181305.358169:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181306.131138:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408341888:0@lo:41: 00000100:00100000:0.0:1789181306.131237:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181306.131553:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408341888 00000100:00100000:3.0:1789181306.131564:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408341888 00000100:00100000:3.0:1789181306.131622:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789181306.131633:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408341888:12345-0@lo:41: 00000004:00000024:3.0:1789181306.131678:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789181306.134847:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408341888:12345-0@lo:41: Request processed in 3211us (3603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181306.134863:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789181306.134943:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408341888:0@lo:41: 00010000:00010000:2.0:1789181306.379940:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181307.405029:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181307.659980:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408342400:0@lo:400: 00000100:00100000:3.0:1789181307.660053:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660110:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408342912:0@lo:400: 00000100:00100000:3.0:1789181307.660135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660161:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789181307.660166:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408342016:0@lo:400: 00000100:00100000:3.0:1789181307.660190:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660220:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408342528:0@lo:400: 00000100:00100000:3.0:1789181307.660242:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660261:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408343040:0@lo:400: 00000100:00100000:3.0:1789181307.660279:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660306:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408342144:0@lo:400: 00000100:00100000:3.0:1789181307.660329:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660345:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408342656:0@lo:400: 00000100:00100000:3.0:1789181307.660364:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660380:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408343168:0@lo:400: 00000100:00100000:3.0:1789181307.660414:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660433:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789181307.660439:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408342272:0@lo:400: 00000100:00100000:3.0:1789181307.660458:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660472:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408342784:0@lo:400: 00000100:00100000:3.0:1789181307.660491:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660501:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408343296:0@lo:400: 00000100:00100000:3.0:1789181307.660531:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181307.660560:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408342400 00000100:00100000:3.0:1789181307.660568:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408342400 00000100:00100000:3.0:1789181307.660623:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408342144 00000100:00100000:3.0:1789181307.660626:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408342144 00000100:00100000:3.0:1789181307.660639:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408342656 00000100:00100000:3.0:1789181307.660640:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408342656 00000100:00100000:3.0:1789181307.660661:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408343168 00000100:00100000:3.0:1789181307.660663:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408343168 00000100:00100000:3.0:1789181307.660679:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408342784 00000100:00100000:3.0:1789181307.660682:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408342784 00000100:00100000:3.0:1789181307.660695:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408343296 00000100:00100000:3.0:1789181307.660697:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408343296 00000100:00100000:3.0:1789181307.660710:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789181307.660719:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408342400:12345-0@lo:400: 00000100:00100000:3.0:1789181307.660794:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408342400:12345-0@lo:400: Request processed in 76us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181307.660802:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789181307.660820:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789181307.660826:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408342144:12345-0@lo:400: 00000100:00100000:3.0:1789181307.660856:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408342144:12345-0@lo:400: Request processed in 31us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181307.660868:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789181307.660881:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789181307.660887:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408342656:12345-0@lo:400: 00000100:00100000:3.0:1789181307.660914:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408342656:12345-0@lo:400: Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181307.660919:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789181307.660929:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789181307.660934:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408343168:12345-0@lo:400: 00000100:00100000:3.0:1789181307.660957:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408343168:12345-0@lo:400: Request processed in 23us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181307.660962:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789181307.660974:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181307.660979:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408342784:12345-0@lo:400: 00000100:00100000:3.0:1789181307.661003:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408342784:12345-0@lo:400: Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181307.661009:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181307.661021:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181307.661027:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408343296:12345-0@lo:400: 00000100:00100000:3.0:1789181307.661050:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408343296:12345-0@lo:400: Request processed in 24us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181307.661055:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181307.661073:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408342912 00000100:00100000:3.0:1789181307.661076:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408342912 00000100:00100000:3.0:1789181307.661099:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408343040 00000100:00100000:3.0:1789181307.661101:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408343040 00000100:00100000:3.0:1789181307.661117:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181307.661129:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408342912:12345-0@lo:400: 00000100:00100000:3.0:1789181307.661156:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408342912:12345-0@lo:400: Request processed in 29us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181307.661161:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181307.661172:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181307.661177:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408343040:12345-0@lo:400: 00000100:00100000:3.0:1789181307.661213:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408343040:12345-0@lo:400: Request processed in 36us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181307.661218:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181307.661235:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408342528 00000100:00100000:3.0:1789181307.661238:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408342528 00000100:00100000:3.0:1789181307.661258:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408342272 00000100:00100000:3.0:1789181307.661261:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408342272 00000100:00100000:3.0:1789181307.661272:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789181307.661277:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408342528:12345-0@lo:400: 00000100:00100000:3.0:1789181307.661313:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408342528:12345-0@lo:400: Request processed in 37us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181307.661319:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789181307.661329:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789181307.661333:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408342272:12345-0@lo:400: 00000100:00100000:3.0:1789181307.661353:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408342272:12345-0@lo:400: Request processed in 20us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181307.661358:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789181307.661382:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181307.661386:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181307.661388:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181307.661419:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408342272:0@lo:400: 00010000:00080000:3.0:1789181307.661440:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c4380 x1876092408342784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181307.661449:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408342784:0@lo:400: 00010000:00080000:3.0:1789181307.661457:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c7100 x1876092408343296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181307.661464:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408343296:0@lo:400: 00010000:00080000:3.0:1789181307.661471:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7f64700 x1876092408342144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181307.661477:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408342144:0@lo:400: 00010000:00080000:3.0:1789181307.661484:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c6680 x1876092408342656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181307.661491:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408342656:0@lo:400: 00010000:00080000:3.0:1789181307.661498:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c4000 x1876092408343168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181307.661504:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408343168:0@lo:400: 00000100:00100000:3.0:1789181307.661540:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408342528:0@lo:400: 00010000:00080000:3.0:1789181307.661548:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c4700 x1876092408343040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181307.661555:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408343040:0@lo:400: 00010000:00080000:3.0:1789181307.661563:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c4a80 x1876092408342400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181307.661570:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408342400:0@lo:400: 00010000:00080000:3.0:1789181307.661584:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c7480 x1876092408342912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181307.661591:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408342912:0@lo:400: 00000100:00100000:0.0:1789181307.661840:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408342016 00000100:00100000:0.0:1789181307.661845:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408342016 00000100:00100000:0.0:1789181307.661887:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789181307.661894:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:3643:x1876092408342016:12345-0@lo:400: 00000100:00100000:0.0:1789181307.661938:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+15:3643:x1876092408342016:12345-0@lo:400: Request processed in 45us (1747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181307.661943:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789181307.661979:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408342016:0@lo:400: 00010000:00010000:3.0:1789181308.431695:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181308.683981:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408343424:0@lo:41: 00000100:00100000:0.0:1789181308.684094:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181308.684232:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408343424 00000100:00100000:3.0:1789181308.684243:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408343424 00000100:00100000:3.0:1789181308.684317:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789181308.684329:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408343424:12345-0@lo:41: 00000004:00000024:3.0:1789181308.684381:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789181308.684449:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408343424:12345-0@lo:41: Request processed in 121us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181308.684457:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789181308.684708:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408343424:0@lo:41: 00000001:02000400:1.0:1789181309.070238:0:9876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789181309.458392:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789181310.113079:0:9929:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789181310.113476:0:9929:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789181310.221099:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181310.221128:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408343552:0@lo:13: 00000100:00100000:2.0:1789181310.221210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181310.221275:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408343552 00000100:00100000:2.0:1789181310.221284:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408343552 00000100:00100000:2.0:1789181310.221341:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789181310.221351:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408343552:12345-0@lo:13: 00002000:00000024:2.0:1789181310.221389:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181310.221437:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408343552:12345-0@lo:13: Request processed in 88us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181310.221444:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789181310.221468:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789181310.221501:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc320a680 x1876092408343552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181310.221534:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408343552:0@lo:13: 00000100:00100000:0.0:1789181310.221874:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181310.221884:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408343680:0@lo:13: 00000100:00100000:0.0:1789181310.221919:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181310.222069:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408343680 00000100:00100000:2.0:1789181310.222074:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408343680 00000100:00100000:2.0:1789181310.222118:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789181310.222125:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408343680:12345-0@lo:13: 00002000:00000024:2.0:1789181310.222137:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181310.222173:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408343680:12345-0@lo:13: Request processed in 48us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181310.222209:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789181310.222235:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc437bb80 x1876092408343680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181310.222249:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408343680:0@lo:13: 00000100:00080000:3.0:1789181310.222403:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181310.486645:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181311.249657:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181311.249686:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408343808:0@lo:41: 00000100:00100000:3.0:1789181311.249783:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.249978:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408343808 00000100:00100000:0.0:1789181311.249988:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408343808 00000100:00100000:0.0:1789181311.250048:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789181311.250058:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408343808:12345-0@lo:41: 00000004:00000024:0.0:1789181311.250092:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789181311.250148:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408343808:12345-0@lo:41: Request processed in 92us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.250155:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789181311.250236:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408343808:0@lo:41: 10000000:01000000:3.0:1789181311.263104:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789181311.263112:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1dfb02c800 from 39 10000000:01000000:3.0:1789181311.263118:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789181311.263181:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.263193:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.263205:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.263254:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408343936:0@lo:101: 00000100:00100000:3.0:1789181311.263335:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.263394:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210000 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.263574:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408343936 00000100:00100000:2.0:1789181311.263584:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408343936 00000100:00100000:2.0:1789181311.263639:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789181311.263649:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408343936:12345-0@lo:101: 00010000:00010000:2.0:1789181311.263661:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181311.263673:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523200/0x76fb555283516ed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516ed0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.263695:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523200/0x76fb555283516ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516ed0 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.263703:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523200/0x76fb555283516ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ed0 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.263712:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523200, rc 0) 00000100:00100000:2.0:1789181311.263782:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408343936:12345-0@lo:101: Request processed in 135us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.263805:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789181311.264046:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408343936:0@lo:101: 00010000:00010000:3.0:1789181311.264062:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.264071:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.264133:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408344064:0@lo:501: 00000100:00100000:3.0:1789181311.264176:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.264210:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210000 going to sleep for 11 seconds 00000100:00100000:1.0:1789181311.264273:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408344064 00000100:00100000:1.0:1789181311.264278:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408344064 00000100:00100000:1.0:1789181311.264313:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789181311.264320:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408344064:12345-0@lo:501: 00000100:00100000:1.0:1789181311.264452:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408344064:12345-0@lo:501: Request processed in 130us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181311.264459:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789181311.264575:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408344064:0@lo:501: 00000100:00100000:3.0:1789181311.264602:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408344192:0@lo:503: 00000100:00100000:3.0:1789181311.264646:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.264667:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210000 going to sleep for 11 seconds 00000100:00100000:1.0:1789181311.264715:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408344192 00000100:00100000:1.0:1789181311.264720:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408344192 00000100:00100000:1.0:1789181311.264772:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789181311.264778:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408344192:12345-0@lo:503: 00000100:00100000:1.0:1789181311.264885:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408344192:12345-0@lo:503: Request processed in 107us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181311.264898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789181311.265061:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408344192:0@lo:503: 00000100:00100000:0.0:1789181311.266257:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9981:1876092408344320:0@lo:502: 00000100:00100000:0.0:1789181311.266323:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.266368:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.266488:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408344320 00000100:00100000:3.0:1789181311.266495:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408344320 00000100:00100000:3.0:1789181311.266537:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789181311.266546:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9981:x1876092408344320:12345-0@lo:502: 00000100:00100000:3.0:1789181311.266668:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9981:x1876092408344320:12345-0@lo:502: Request processed in 123us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.266683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789181311.266790:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9981:1876092408344320:0@lo:502: 00000100:00100000:0.0:1789181311.266860:0:9981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9981:1876092408344448:0@lo:502: 00000100:00100000:0.0:1789181311.266892:0:9981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.266915:0:9981:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.267106:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408344448 00000100:00100000:3.0:1789181311.267111:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408344448 00000100:00100000:3.0:1789181311.267143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789181311.267150:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9981:x1876092408344448:12345-0@lo:502: 00000100:00100000:3.0:1789181311.267236:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:9981:x1876092408344448:12345-0@lo:502: Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.267242:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789181311.267402:0:9981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9981:1876092408344448:0@lo:502: 00000040:00080000:1.0:1789181311.267423:0:9981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789181311.267609:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789181311.267630:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789181311.267639:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.267650:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181311.267659:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789181311.267662:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789181311.267665:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789181311.267690:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.267698:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.267707:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.267760:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408344576:0@lo:101: 00000100:00100000:3.0:1789181311.267813:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.267833:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210780 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.268112:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408344576 00000100:00100000:2.0:1789181311.268118:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408344576 00000100:00100000:2.0:1789181311.268145:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789181311.268152:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408344576:12345-0@lo:101: 00010000:00010000:2.0:1789181311.268161:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181311.268191:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522e00/0x76fb555283516ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516ede expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.268215:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522e00/0x76fb555283516ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516ede expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.268227:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522e00/0x76fb555283516ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ede expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.268236:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522e00, rc 0) 00000100:00100000:2.0:1789181311.268281:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408344576:12345-0@lo:101: Request processed in 129us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.268288:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789181311.268424:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408344576:0@lo:101: 00010000:00010000:3.0:1789181311.268436:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.268445:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.268498:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408344704:0@lo:501: 00000100:00100000:3.0:1789181311.268524:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.268547:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210780 going to sleep for 11 seconds 00000100:00100000:1.0:1789181311.268625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408344704 00000100:00100000:1.0:1789181311.268629:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408344704 00000100:00100000:1.0:1789181311.272030:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789181311.272057:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408344704:12345-0@lo:501: 00000100:00100000:1.0:1789181311.272273:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408344704:12345-0@lo:501: Request processed in 229us (3747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181311.272281:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789181311.272655:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408344704:0@lo:501: 00000100:00100000:3.0:1789181311.272762:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408344832:0@lo:503: 00000100:00100000:3.0:1789181311.272850:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.272887:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210780 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.273119:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408344832 00000100:00100000:2.0:1789181311.273126:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408344832 00000100:00100000:2.0:1789181311.273187:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789181311.273197:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408344832:12345-0@lo:503: 00000100:00100000:2.0:1789181311.273301:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408344832:12345-0@lo:503: Request processed in 105us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.273307:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789181311.276054:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408344832:0@lo:503: 00000100:00100000:3.0:1789181311.277607:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9982:1876092408344960:0@lo:502: 00000100:00100000:3.0:1789181311.277683:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.277751:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc72106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.277819:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408344960 00000100:00100000:2.0:1789181311.277826:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408344960 00000100:00100000:2.0:1789181311.278079:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789181311.278090:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:9982:x1876092408344960:12345-0@lo:502: 00000100:00100000:2.0:1789181311.278225:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:9982:x1876092408344960:12345-0@lo:502: Request processed in 138us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.278233:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789181311.280027:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9982:1876092408344960:0@lo:502: 00000020:01000000:3.0:1789181311.280078:0:9982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181311.280093:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181311.280095:0:9982:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789181311.280101:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789181311.280103:0:9982:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789181311.280148:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9982:1876092408345088:0@lo:502: 00000100:00100000:3.0:1789181311.280226:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.280269:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc72106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181311.280395:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408345088 00000100:00100000:1.0:1789181311.280402:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408345088 00000100:00100000:1.0:1789181311.280458:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789181311.280468:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:9982:x1876092408345088:12345-0@lo:502: 00000100:00100000:1.0:1789181311.280617:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:9982:x1876092408345088:12345-0@lo:502: Request processed in 151us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181311.280624:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789181311.281083:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9982:1876092408345088:0@lo:502: 00000020:01000000:3.0:1789181311.281107:0:9982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181311.281114:0:9982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181311.281116:0:9982:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789181311.281119:0:9982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789181311.281435:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789181311.281458:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789181311.281470:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.281485:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181311.281496:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789181311.281499:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1df1a64800 from 39 10000000:01000000:1.0:1789181311.281511:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789181311.281545:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.281554:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.281565:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181311.281581:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408345216:0@lo:101: 00000100:00100000:1.0:1789181311.281626:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.281669:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.283073:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408345216 00000100:00100000:3.0:1789181311.283088:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408345216 00000100:00100000:3.0:1789181311.283154:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789181311.283176:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408345216:12345-0@lo:101: 00010000:00010000:3.0:1789181311.283193:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181311.283210:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e00866600/0x76fb555283516ef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516eec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.283240:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e00866600/0x76fb555283516ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516eec expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.283251:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e00866600/0x76fb555283516ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516eec expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.283259:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e00866600, rc 0) 00000100:00100000:3.0:1789181311.283320:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408345216:12345-0@lo:101: Request processed in 157us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.283326:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789181311.285020:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408345216:0@lo:101: 00010000:00010000:1.0:1789181311.285048:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.285059:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181311.285152:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408345344:0@lo:501: 00000100:00100000:1.0:1789181311.285218:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.285257:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.289453:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408345344 00000100:00100000:3.0:1789181311.289471:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408345344 00000100:00100000:3.0:1789181311.289542:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789181311.289569:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408345344:12345-0@lo:501: 00000100:00100000:3.0:1789181311.289801:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408345344:12345-0@lo:501: Request processed in 233us (4581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.289808:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789181311.290816:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408345344:0@lo:501: 00000100:00100000:1.0:1789181311.290895:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408345472:0@lo:503: 00000100:00100000:1.0:1789181311.290992:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.291032:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.296678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408345472 00000100:00100000:3.0:1789181311.296697:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408345472 00000100:00100000:3.0:1789181311.296797:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789181311.296808:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408345472:12345-0@lo:503: 00000100:00100000:3.0:1789181311.297024:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408345472:12345-0@lo:503: Request processed in 217us (6030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.297032:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789181311.297373:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408345472:0@lo:503: 00000100:00100000:2.0:1789181311.299806:0:9983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9983:1876092408345600:0@lo:502: 00000100:00100000:2.0:1789181311.299894:0:9983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181311.299945:0:9983:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34da840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181311.300387:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408345600 00000100:00100000:0.0:1789181311.300398:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408345600 00000100:00100000:0.0:1789181311.300453:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789181311.300464:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:9983:x1876092408345600:12345-0@lo:502: 00000100:00100000:0.0:1789181311.300609:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:9983:x1876092408345600:12345-0@lo:502: Request processed in 147us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.300617:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789181311.301192:0:9983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9983:1876092408345600:0@lo:502: 00000100:00100000:2.0:1789181311.301251:0:9983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9983:1876092408345728:0@lo:502: 00000100:00100000:2.0:1789181311.301295:0:9983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181311.301330:0:9983:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34da840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181311.301394:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408345728 00000100:00100000:1.0:1789181311.301406:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408345728 00000100:00100000:1.0:1789181311.301447:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789181311.301455:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:9983:x1876092408345728:12345-0@lo:502: 00000100:00100000:1.0:1789181311.301551:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:9983:x1876092408345728:12345-0@lo:502: Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181311.301558:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789181311.301720:0:9983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9983:1876092408345728:0@lo:502: 00000040:00080000:2.0:1789181311.301774:0:9983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789181311.303012:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789181311.303062:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789181311.303076:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.303090:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181311.303100:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789181311.303103:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1df1a64800 from 6 10000000:01000000:1.0:1789181311.303106:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789181311.303147:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.303155:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.303676:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181311.303822:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408345856:0@lo:101: 00000100:00100000:0.0:1789181311.303891:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.303941:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.304159:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408345856 00000100:00100000:3.0:1789181311.304178:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408345856 00000100:00100000:3.0:1789181311.304235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789181311.304246:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408345856:12345-0@lo:101: 00010000:00010000:3.0:1789181311.304262:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181311.304279:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e00867a00/0x76fb555283516f01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516efa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.304305:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e00867a00/0x76fb555283516f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516efa expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.304316:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e00867a00/0x76fb555283516f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516efa expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.304325:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e00867a00, rc 0) 00000100:00100000:3.0:1789181311.304367:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408345856:12345-0@lo:101: Request processed in 123us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.304563:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408345856:0@lo:101: 00010000:00010000:0.0:1789181311.304578:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.304587:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181311.304643:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408345984:0@lo:256: 00000100:00100000:0.0:1789181311.304693:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.304718:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.305211:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789181311.305253:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408345984 00000100:00100000:3.0:1789181311.305259:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408345984 00000100:00100000:3.0:1789181311.305282:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789181311.305289:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408345984:12345-0@lo:256: 20000000:01000000:3.0:1789181311.305305:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789181311.305324:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789181311.305328:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789181311.306079:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408345984:12345-0@lo:256: Request processed in 785us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.306091:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789181311.306660:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408345984:0@lo:256: 10000000:01000000:0.0:1789181311.306757:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789181311.306767:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.306780:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181311.306802:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789181311.306805:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1789181311.306808:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789181311.306843:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.306851:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.306860:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181311.306882:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408346112:0@lo:101: 00000100:00100000:0.0:1789181311.307061:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.307103:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.307234:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408346112 00000100:00100000:2.0:1789181311.307242:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408346112 00000100:00100000:2.0:1789181311.307290:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789181311.307301:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408346112:12345-0@lo:101: 00010000:00010000:2.0:1789181311.307314:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181311.307327:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516f0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516f08 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.307350:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516f08 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.307360:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516f08 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.307369:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523c00, rc 0) 00000100:00100000:2.0:1789181311.307436:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408346112:12345-0@lo:101: Request processed in 137us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.307442:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789181311.308070:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408346112:0@lo:101: 00010000:00010000:0.0:1789181311.308086:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.308106:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181311.308204:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408346240:0@lo:501: 00000100:00100000:0.0:1789181311.308244:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.308266:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.308552:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408346240 00000100:00100000:3.0:1789181311.308558:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408346240 00000100:00100000:3.0:1789181311.308593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789181311.308601:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408346240:12345-0@lo:501: 00000100:00100000:3.0:1789181311.308774:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408346240:12345-0@lo:501: Request processed in 172us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.308781:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789181311.309361:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408346240:0@lo:501: 00000100:00100000:0.0:1789181311.309429:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408346368:0@lo:503: 00000100:00100000:0.0:1789181311.309487:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.309521:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.309628:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408346368 00000100:00100000:2.0:1789181311.309634:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408346368 00000100:00100000:2.0:1789181311.309674:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789181311.309685:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408346368:12345-0@lo:503: 00000100:00100000:2.0:1789181311.309809:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408346368:12345-0@lo:503: Request processed in 128us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.309816:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789181311.310628:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408346368:0@lo:503: 00000100:00100000:1.0:1789181311.313111:0:9984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9984:1876092408346496:0@lo:502: 00000100:00100000:0.0:1789181311.313589:0:9984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.313642:0:9984:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.313741:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408346496 00000100:00100000:2.0:1789181311.313750:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408346496 00000100:00100000:2.0:1789181311.313814:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789181311.313823:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+20:9984:x1876092408346496:12345-0@lo:502: 00000100:00100000:2.0:1789181311.313961:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+20:9984:x1876092408346496:12345-0@lo:502: Request processed in 138us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.313969:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789181311.314111:0:9984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9984:1876092408346496:0@lo:502: 00000020:01000000:0.0:1789181311.314142:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789181311.314149:0:9984:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789181311.314156:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181311.314158:0:9984:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789181311.314174:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789181311.314178:0:9984:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:0.0:1789181311.314199:0:9984:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789181311.314202:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181311.314217:0:9984:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c1dfaf4b380) 00000020:00000080:0.0:1789181311.314243:0:9984:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1789181311.314250:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789181311.314353:0:9984:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789181311.314363:0:9984:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789181311.314370:0:9984:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb555283516f1d 00010000:00080000:0.0:1789181311.314398:0:9984:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1de7d93000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1789181311.314626:0:9984:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1789181311.314798:0:9984:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789181311.314811:0:9984:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789181311.315032:0:9984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181311.315140:0:9984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181311.315279:0:9984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789181311.315368:0:9984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789181311.315912:0:9985:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181311.315917:0:9985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789181311.316595:0:9984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789181311.316608:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789181311.316647:0:9984:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789181311.316677:0:9984:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb555283516f24 00000100:00080000:3.0:1789181311.316688:0:9984:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789181311.316701:0:9984:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c1de7d93000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181311.316779:0:9984:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3849880 x1876092408346624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789181311.316816:0:9984:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789181311.316922:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408346880:0@lo:400: 00000100:00100000:3.0:1789181311.317329:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.317367:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408347392:0@lo:400: 00000100:00100000:3.0:1789181311.317390:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.317413:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789181311.317419:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408346752:0@lo:400: 00000100:00100000:3.0:1789181311.317439:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.317456:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408347264:0@lo:400: 00000100:00100000:3.0:1789181311.317474:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.317491:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408347776:0@lo:400: 00000100:00100000:3.0:1789181311.317512:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.317545:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408346880 00000100:00100000:3.0:1789181311.317552:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408346880 00000100:00100000:3.0:1789181311.317591:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408346752 00000100:00100000:3.0:1789181311.317594:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408346752 00000100:00100000:3.0:1789181311.317604:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408347264 00000100:00100000:3.0:1789181311.317606:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408347264 00000100:00100000:3.0:1789181311.317625:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408347776 00000100:00100000:3.0:1789181311.317627:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408347776 00000100:00080000:1.0:1789181311.317629:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181311.317642:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789181311.317650:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408346880:12345-0@lo:400: 00000100:00100000:3.0:1789181311.317712:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408346880:12345-0@lo:400: Request processed in 61us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.317719:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789181311.317759:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789181311.317774:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408346752:12345-0@lo:400: 00000100:00100000:3.0:1789181311.317804:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408346752:12345-0@lo:400: Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.317810:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789181311.317821:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789181311.317826:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408347264:12345-0@lo:400: 00000100:00100000:3.0:1789181311.317851:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408347264:12345-0@lo:400: Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.317856:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789181311.317866:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789181311.317871:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408347776:12345-0@lo:400: 00000100:00100000:3.0:1789181311.317896:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408347776:12345-0@lo:400: Request processed in 24us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.317901:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789181311.317920:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408347392 00000100:00100000:3.0:1789181311.317923:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408347392 00000100:00100000:0.0:1789181311.318029:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408347008:0@lo:400: 00000100:00100000:0.0:1789181311.318062:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.318084:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408347520:0@lo:400: 00000100:00100000:0.0:1789181311.318105:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.318126:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789181311.318132:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408347136:0@lo:400: 00000100:00100000:0.0:1789181311.318152:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.318178:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408347648:0@lo:400: 00000100:00100000:0.0:1789181311.318199:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.318223:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408347008 00000100:00100000:0.0:1789181311.318227:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408347008 00000100:00100000:0.0:1789181311.318255:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789181311.318261:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408347008:12345-0@lo:400: 00000100:00100000:0.0:1789181311.318297:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408347008:12345-0@lo:400: Request processed in 37us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.318303:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789181311.318321:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408347520 00000100:00100000:0.0:1789181311.318324:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408347520 00000100:00100000:0.0:1789181311.318361:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181311.318367:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408347520:12345-0@lo:400: 00000100:00100000:0.0:1789181311.318398:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408347520:12345-0@lo:400: Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.318403:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181311.318445:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408347008:0@lo:400: 00010000:00080000:0.0:1789181311.318456:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3849180 x1876092408347520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181311.318465:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408347520:0@lo:400: 00000100:00100000:0.0:1789181311.318486:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408347136 00000100:00100000:0.0:1789181311.318490:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408347136 00000100:00100000:0.0:1789181311.318509:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408347648 00000100:00100000:0.0:1789181311.318511:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408347648 00000100:00100000:0.0:1789181311.318523:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789181311.318528:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408347136:12345-0@lo:400: 00000100:00100000:0.0:1789181311.318561:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408347136:12345-0@lo:400: Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.318567:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789181311.318579:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789181311.318584:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408347648:12345-0@lo:400: 00000100:00100000:0.0:1789181311.318622:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408347648:12345-0@lo:400: Request processed in 38us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.318627:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789181311.318650:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3848e00 x1876092408347136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181311.318658:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408347136:0@lo:400: 00010000:00080000:0.0:1789181311.318676:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3849500 x1876092408347648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181311.318684:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408347648:0@lo:400: 00000100:00100000:2.0:1789181311.319095:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408346624:0@lo:8: 00000100:00100000:2.0:1789181311.319135:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.319428:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408346624 00000100:00100000:3.0:1789181311.319433:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408346624 00000100:00100000:3.0:1789181311.319448:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181311.319456:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408347392:12345-0@lo:400: 00000100:00100000:3.0:1789181311.319498:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408347392:12345-0@lo:400: Request processed in 44us (2107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.319503:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181311.319515:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181311.319519:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408346624:12345-0@lo:8: 00010000:00080000:3.0:1789181311.319544:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1789181311.319585:0:8435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb555283516f2b 00002000:00100000:3.0:1789181311.319599:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c1de7d92000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789181311.319604:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1789181311.319609:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789181311.319671:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1789181311.319888:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789181311.319917:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3849f80 x1876092408346752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181311.319948:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408346752:0@lo:400: 00010000:00080000:1.0:1789181311.319963:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc384b800 x1876092408347264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181311.319970:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408347264:0@lo:400: 00010000:00080000:1.0:1789181311.319982:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3848a80 x1876092408347776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181311.319990:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408347776:0@lo:400: 00010000:00080000:1.0:1789181311.320001:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc384bb80 x1876092408346880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181311.320008:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408346880:0@lo:400: 00010000:00080000:1.0:1789181311.320018:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc384a300 x1876092408347392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181311.320025:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408347392:0@lo:400: 00002000:00080000:3.0:1789181311.321340:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789181311.321380:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c1df9d35800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181311.321465:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876092408346624:12345-0@lo:8: Request processed in 1942us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.321475:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000000:0.0:1789181311.321587:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181311.321594:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181311.321596:0:9984:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789181311.321601:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181311.321605:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181311.321606:0:9984:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789181311.321609:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789181311.321610:0:9984:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789181311.321671:0:9984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9984:1876092408347904:0@lo:502: 00000100:00100000:0.0:1789181311.321744:0:9984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.321847:0:9984:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd2a98f00 going to sleep for 11 seconds 00010000:00080000:1.0:1789181311.322050:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3849880 x1876092408346624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181311.322061:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789181311.322070:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789181311.322078:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789181311.322083:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789181311.322085:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7d93000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789181311.322132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408347904 00000100:00100000:3.0:1789181311.322139:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408347904 00000100:00100000:3.0:1789181311.322191:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789181311.322200:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:9984:x1876092408347904:12345-0@lo:502: 00000100:00100000:3.0:1789181311.322312:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:9984:x1876092408347904:12345-0@lo:502: Request processed in 113us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.322319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789181311.328245:0:9984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9984:1876092408347904:0@lo:502: 00000020:01000000:0.0:1789181311.328312:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181311.328326:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181311.328329:0:9984:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789181311.328337:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1789181311.328516:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1789181311.328540:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789181311.328550:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.328561:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181311.328573:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789181311.328575:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1dc32aa000 from 39 10000000:01000000:0.0:1789181311.328591:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181311.328624:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.328632:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.328641:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181311.328659:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408348032:0@lo:101: 00000100:00100000:0.0:1789181311.328717:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.328772:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd2a98f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.329617:0:9986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9986:1876092408348160:0@lo:700: 00000100:00100000:2.0:1789181311.329663:0:9986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181311.329682:0:9986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34da240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.329756:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408348160 00000100:00100000:3.0:1789181311.329763:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408348160 00000100:00100000:3.0:1789181311.329832:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181311.329842:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9986:x1876092408348160:12345-0@lo:700: 00000100:00100000:3.0:1789181311.329883:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8445:1876092408348288:0@lo:700: 00000100:00100000:3.0:1789181311.329915:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.329947:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.329962:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408348288 00000100:00100000:3.0:1789181311.329965:0:6528:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408348288 00000100:00100000:3.0:1789181311.329990:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181311.330005:0:6528:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8445:x1876092408348288:12345-0@lo:700: 00000100:00080000:0.0:1789181311.330329:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181311.331119:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408348032 00000100:00100000:2.0:1789181311.331129:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408348032 00000100:00100000:2.0:1789181311.331186:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789181311.331196:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408348032:12345-0@lo:101: 00010000:00010000:2.0:1789181311.331208:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181311.331229:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522200/0x76fb555283516f39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516f32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.331257:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522200/0x76fb555283516f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516f32 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.331282:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522200/0x76fb555283516f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516f32 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.331292:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522200, rc 0) 00000100:00100000:2.0:1789181311.331364:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408348032:12345-0@lo:101: Request processed in 170us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.331371:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789181311.331501:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408348032:0@lo:101: 00010000:00010000:0.0:1789181311.331519:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.331529:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181311.331602:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408348416:0@lo:501: 00000100:00100000:0.0:1789181311.331636:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.331672:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd2a98f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.331812:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408348416 00000100:00100000:2.0:1789181311.331818:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408348416 00000100:00100000:2.0:1789181311.335545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789181311.335576:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408348416:12345-0@lo:501: 00000100:00100000:2.0:1789181311.335855:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408348416:12345-0@lo:501: Request processed in 295us (4218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.335864:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789181311.336078:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408348416:0@lo:501: 00000100:00100000:0.0:1789181311.336138:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408348544:0@lo:503: 00000100:00100000:0.0:1789181311.336212:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.336252:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd2a98f00 going to sleep for 11 seconds 00000004:00080000:1.0:1789181311.336559:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789181311.336569:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408346624:0@lo:8: 00000100:00100000:3.0:1789181311.336737:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408348544 00000100:00100000:3.0:1789181311.336745:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408348544 00000100:00100000:3.0:1789181311.336802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789181311.336810:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408348544:12345-0@lo:503: 00000100:00100000:3.0:1789181311.337050:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408348544:12345-0@lo:503: Request processed in 114us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.337059:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789181311.337190:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408348544:0@lo:503: 00000004:00080000:0.0:1789181311.337231:0:9985:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789181311.337300:0:9985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 267324575724ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789181311.337307:0:9985:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789181311.340269:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9987:1876092408348672:0@lo:502: 00000100:00100000:2.0:1789181311.340350:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181311.340398:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.340465:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408348672 00000100:00100000:3.0:1789181311.340473:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408348672 00000100:00100000:3.0:1789181311.340524:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789181311.340534:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:9987:x1876092408348672:12345-0@lo:502: 00000100:00100000:3.0:1789181311.340658:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:9987:x1876092408348672:12345-0@lo:502: Request processed in 125us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.340665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789181311.341711:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9987:1876092408348672:0@lo:502: 00000100:00100000:3.0:1789181311.341826:0:9987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9987:1876092408348800:0@lo:502: 00000100:00100000:3.0:1789181311.341877:0:9987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.341909:0:9987:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181311.342188:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408348800 00000100:00100000:0.0:1789181311.342195:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408348800 00000100:00100000:0.0:1789181311.342243:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789181311.342252:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:9987:x1876092408348800:12345-0@lo:502: 00000100:00100000:0.0:1789181311.342623:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:9987:x1876092408348800:12345-0@lo:502: Request processed in 370us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.342630:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000004:00080000:0.0:1789181311.343525:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 40000000:02000000:1.0:1789181311.343659:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1789181311.347680:0:9987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9987:1876092408348800:0@lo:502: 00000040:00080000:0.0:1789181311.348045:0:9987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:0.0:1789181311.356422:0:6528:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8445:x1876092408348288:12345-0@lo:700: Request processed in 26411us (26500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.356439:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789181311.362239:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc384a300 x1876092408348288/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789181327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181311.362264:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8445:1876092408348288:0@lo:700: 40000000:02000000:1.0:1789181311.362285:0:8445:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:01000000:2.0:1789181311.364471:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789181311.364514:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181311.364525:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.364538:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181311.364937:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789181311.364943:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1dc32aa000 from 6 10000000:01000000:3.0:1789181311.364946:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789181311.365008:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.365019:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.365053:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.365078:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408348928:0@lo:101: 00000100:00100000:3.0:1789181311.365145:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.365201:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6540 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.366562:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408348928 00000100:00100000:2.0:1789181311.366577:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408348928 00000100:00100000:2.0:1789181311.366645:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789181311.366656:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408348928:12345-0@lo:101: 00010000:00010000:2.0:1789181311.366673:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181311.366690:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522c00/0x76fb555283516f47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516f40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.366718:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522c00/0x76fb555283516f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516f40 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.366750:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522c00/0x76fb555283516f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516f40 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181311.366759:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522c00, rc 0) 00000100:00100000:2.0:1789181311.367046:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408348928:12345-0@lo:101: Request processed in 390us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.367055:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789181311.368030:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408348928:0@lo:101: 00010000:00010000:3.0:1789181311.368053:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.368063:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.368136:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408349056:0@lo:256: 00000100:00100000:3.0:1789181311.368205:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.368246:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408349056 00000100:00100000:3.0:1789181311.368252:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408349056 00000100:00100000:3.0:1789181311.368295:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789181311.368303:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408349056:12345-0@lo:256: 20000000:01000000:3.0:1789181311.368334:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789181311.368350:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789181311.368353:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789181311.368426:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408349056:12345-0@lo:256: Request processed in 124us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.368432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789181311.368469:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.368482:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408349056:0@lo:256: 10000000:01000000:3.0:1789181311.368528:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789181311.368534:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.368542:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181311.368550:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789181311.368553:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789181311.368555:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789181311.368576:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.368584:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.368592:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.368604:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408349184:0@lo:101: 00000100:00100000:3.0:1789181311.368627:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.368648:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408349184 00000100:00100000:3.0:1789181311.368651:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408349184 00000100:00100000:3.0:1789181311.368673:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789181311.368680:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408349184:12345-0@lo:101: 00010000:00010000:3.0:1789181311.368687:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181311.368698:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e00867e00/0x76fb555283516f55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516f4e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.368715:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e00867e00/0x76fb555283516f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516f4e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.368764:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e00867e00/0x76fb555283516f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516f4e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.368773:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e00867e00, rc 0) 00000100:00100000:3.0:1789181311.368821:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408349184:12345-0@lo:101: Request processed in 132us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.368827:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789181311.368853:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.368864:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408349184:0@lo:101: 00010000:00010000:3.0:1789181311.368874:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.368882:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.368930:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408349312:0@lo:501: 00000100:00100000:3.0:1789181311.368955:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.368973:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408349312 00000100:00100000:3.0:1789181311.368977:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408349312 00000100:00100000:3.0:1789181311.368999:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789181311.369006:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408349312:12345-0@lo:501: 00000100:00100000:3.0:1789181311.369115:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408349312:12345-0@lo:501: Request processed in 109us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.369122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789181311.369156:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.369178:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408349312:0@lo:501: 00000100:00100000:3.0:1789181311.369220:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408349440:0@lo:503: 00000100:00100000:3.0:1789181311.369253:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.369271:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408349440 00000100:00100000:3.0:1789181311.369275:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408349440 00000100:00100000:3.0:1789181311.369295:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789181311.369301:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408349440:12345-0@lo:503: 00000100:00100000:3.0:1789181311.369374:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408349440:12345-0@lo:503: Request processed in 72us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.369380:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789181311.369411:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd132c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.369422:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408349440:0@lo:503: 00000001:00100000:3.0:1789181311.376373:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789181311.376571:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9986:x1876092408348160:12345-0@lo:700: Request processed in 46725us (46901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.376585:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789181311.376693:0:9986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc320b480 x1876092408348160/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789181327 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181311.376709:0:9986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9986:1876092408348160:0@lo:700: 00000100:00100000:1.0:1789181311.377438:0:9988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2754000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9988:1876092408349568:0@lo:502: 00000100:00100000:1.0:1789181311.377505:0:9988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.377550:0:9988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181311.377651:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408349568 00000100:00100000:0.0:1789181311.377659:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408349568 00000100:00100000:0.0:1789181311.377717:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789181311.377753:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:9988:x1876092408349568:12345-0@lo:502: 00000100:00100000:0.0:1789181311.377898:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:9988:x1876092408349568:12345-0@lo:502: Request processed in 148us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.377906:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789181311.378331:0:9988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2754000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9988:1876092408349568:0@lo:502: 00000020:01000000:1.0:1789181311.378362:0:9988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789181311.378371:0:9988:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789181311.378391:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181311.378394:0:9988:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789181311.378401:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789181311.378406:0:9988:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:1.0:1789181311.378432:0:9988:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789181311.378435:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789181311.378464:0:9988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c1cc38ecd40) 00000020:00000080:1.0:1789181311.378497:0:9988:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1789181311.378504:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789181311.378598:0:9988:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789181311.378605:0:9988:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789181311.378614:0:9988:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283516f63 00010000:00080000:1.0:1789181311.378646:0:9988:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1cc1dc8000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1789181311.379153:0:9988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1789181311.379299:0:9988:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789181311.379313:0:9988:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789181311.379493:0:9988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181311.379601:0:9988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181311.379747:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789181311.380212:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789181311.381292:0:9989:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181311.381297:0:9989:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789181311.382204:0:9988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789181311.382216:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789181311.382253:0:9988:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789181311.382281:0:9988:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb555283516f6a 00000100:00080000:1.0:1789181311.382292:0:9988:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181311.382304:0:9988:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c1cc1dc8000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181311.382359:0:9988:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc2754000 x1876092408349696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789181311.382470:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408349696:0@lo:8: 00000100:00100000:2.0:1789181311.382552:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789181311.382621:0:9988:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789181311.382710:0:9988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181311.382715:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181311.382717:0:9988:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789181311.382720:0:9988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181311.382745:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181311.382747:0:9988:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789181311.382751:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789181311.382753:0:9988:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789181311.382777:0:9988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9988:1876092408349824:0@lo:502: 00000100:00100000:1.0:1789181311.382838:0:9988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.382856:0:9988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.382958:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408349696 00000100:00100000:3.0:1789181311.382965:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408349696 00000100:00100000:3.0:1789181311.383003:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181311.383011:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1876092408349696:12345-0@lo:8: 00010000:00080000:3.0:1789181311.383041:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1789181311.383069:0:8436:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb555283516f71 00002000:00100000:3.0:1789181311.383082:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c1df1a63800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789181311.383086:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789181311.383090:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789181311.383181:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789181311.383214:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f4b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181311.385006:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408349952:0@lo:13: 00000100:00100000:1.0:1789181311.385070:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789181311.385152:0:9986:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789181311.385185:0:9986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9986:1876092408350080:0@lo:7: 00000100:00100000:0.0:1789181311.385217:0:9986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.385245:0:9986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd2a98d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181311.385264:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408350080 00000100:00100000:0.0:1789181311.385272:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408350080 00000100:00100000:0.0:1789181311.385317:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181311.385327:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9986:x1876092408350080:12345-0@lo:7: 00000100:00100000:3.0:1789181311.387003:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876092408349696:12345-0@lo:8: Request processed in 3984us (4444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.387018:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181311.387080:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408349824 00000100:00100000:3.0:1789181311.387090:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408349824 00000100:00100000:3.0:1789181311.387142:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789181311.387151:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+23:9988:x1876092408349824:12345-0@lo:502: 00000100:00100000:3.0:1789181311.387305:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+23:9988:x1876092408349824:12345-0@lo:502: Request processed in 154us (4465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.387312:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789181311.387370:0:9988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2754e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:9988:1876092408349824:0@lo:502: 00000020:01000000:3.0:1789181311.387410:0:9988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181311.387418:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181311.387420:0:9988:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789181311.387428:0:9988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1789181311.387588:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789181311.387608:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789181311.387617:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.387627:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181311.387638:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789181311.387640:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c1dd13ecd40 from 1 10000000:01000000:3.0:1789181311.387643:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789181311.387675:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.387694:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.387704:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.387745:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408350208:0@lo:101: 00000100:00100000:3.0:1789181311.390909:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.391038:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408350208 00000100:00100000:3.0:1789181311.391049:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408350208 00000100:00100000:3.0:1789181311.391104:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789181311.391115:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408350208:12345-0@lo:101: 00010000:00010000:3.0:1789181311.391136:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181311.391155:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e00867400/0x76fb555283516f7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516f78 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.391199:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e00867400/0x76fb555283516f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516f78 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.391211:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e00867400/0x76fb555283516f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516f78 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.391221:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e00867400, rc 0) 00000100:00100000:3.0:1789181311.391273:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408350208:12345-0@lo:101: Request processed in 160us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.391280:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789181311.391330:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd132c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.391354:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408350208:0@lo:101: 00010000:00010000:3.0:1789181311.391378:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.391388:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.391464:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408350336:0@lo:501: 00000100:00100000:3.0:1789181311.391498:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.391515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408350336 00000100:00100000:3.0:1789181311.391519:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408350336 00000100:00100000:3.0:1789181311.391539:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789181311.391545:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408350336:12345-0@lo:501: 00000100:00100000:3.0:1789181311.391616:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408350336:12345-0@lo:501: Request processed in 71us (117us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789181311.391623:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789181311.391642:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd132c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.391652:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408350336:0@lo:501: 10000000:01000000:3.0:1789181311.391676:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789181311.391682:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.391690:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181311.393226:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408349952 00000100:00100000:3.0:1789181311.393239:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408349952 00000100:00100000:3.0:1789181311.393292:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181311.393302:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876092408349952:12345-0@lo:13: 00002000:00000024:3.0:1789181311.393340:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923877888 avail 3692355584 00000100:00100000:3.0:1789181311.393416:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876092408349952:12345-0@lo:13: Request processed in 115us (8345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.393423:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789181311.393468:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360d180 x1876092408349952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181311.393489:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408349952:0@lo:13: 00010000:00080000:2.0:1789181311.396237:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc2754000 x1876092408349696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181311.396254:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789181311.396265:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789181311.396276:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789181311.396284:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789181311.396288:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dc8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789181311.396958:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789181311.396968:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408349696:0@lo:8: 00002000:00080000:0.0:1789181311.403814:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789181311.403826:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789181311.403926:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9986:x1876092408350080:12345-0@lo:7: Request processed in 18595us (18703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.403937:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789181311.404346:0:9986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360d500 x1876092408350080/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789181327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181311.404362:0:9986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9986:1876092408350080:0@lo:7: 00000004:00080000:2.0:1789181311.404377:0:9986:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789181311.404421:0:9986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9986:1876092408350464:0@lo:5: 00000100:00100000:2.0:1789181311.404458:0:9986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181311.404489:0:9986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.404646:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408350464 00000100:00100000:3.0:1789181311.404653:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408350464 00000100:00100000:3.0:1789181311.404707:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181311.404716:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9986:x1876092408350464:12345-0@lo:5: 00002000:00080000:3.0:1789181311.404761:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789181311.404802:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9986:x1876092408350464:12345-0@lo:5: Request processed in 87us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.404808:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789181311.404876:0:9986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc320b480 x1876092408350464/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181311.404884:0:9986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9986:1876092408350464:0@lo:5: 00000004:00080000:2.0:1789181311.404892:0:9986:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789181311.404915:0:9986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9986:1876092408350592:0@lo:5: 00000100:00100000:2.0:1789181311.404950:0:9986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181311.404970:0:9986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.405016:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408350592 00000100:00100000:3.0:1789181311.405020:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408350592 00000100:00100000:3.0:1789181311.405054:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181311.405061:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9986:x1876092408350592:12345-0@lo:5: 00002000:00080000:3.0:1789181311.405088:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1789181311.406914:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9986:x1876092408350592:12345-0@lo:5: Request processed in 1845us (1955us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789181311.406928:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1789181311.407309:0:9989:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789181311.407361:0:9989:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 267394637208ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789181311.407380:0:9989:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:2.0:1789181311.407507:0:9986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc320b480 x1876092408350592/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181327 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181311.407538:0:9986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9986:1876092408350592:0@lo:5: 00000004:00080000:2.0:1789181311.407557:0:9986:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789181311.407616:0:9986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9986:1876092408350720:0@lo:900: 00000100:00100000:2.0:1789181311.407660:0:9986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181311.407694:0:9986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.408236:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408350720 00000100:00100000:3.0:1789181311.408245:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408350720 00000100:00100000:3.0:1789181311.408397:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181311.408408:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9986:x1876092408350720:12345-0@lo:900: 00000100:00100000:3.0:1789181311.408491:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9986:x1876092408350720:12345-0@lo:900: Request processed in 85us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.408499:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789181311.408627:0:9986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34f8700 x1876092408350720/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789181327 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181311.408646:0:9986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9986:1876092408350720:0@lo:900: 00000004:00080000:0.0:1789181311.411314:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789181311.413593:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181311.413624:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408350848:0@lo:13: 00000100:00100000:0.0:1789181311.413718:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789181311.413788:0:9990:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789181311.413814:0:9990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9990:1876092408350976:0@lo:7: 00000100:00100000:0.0:1789181311.413839:0:9990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.413856:0:9990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.414256:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408350848 00000100:00100000:3.0:1789181311.414266:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408350848 00000100:00080000:0.0:1789181311.414394:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181311.414466:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789181311.414479:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408350848:12345-0@lo:13: 00002000:00000024:3.0:1789181311.414529:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1789181311.414592:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408350848:12345-0@lo:13: Request processed in 116us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.414599:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789181311.414663:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360ea00 x1876092408350848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181311.414683:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408350848:0@lo:13: 00000100:00100000:3.0:1789181311.418049:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408350976 00000100:00100000:3.0:1789181311.418070:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408350976 00000100:00100000:3.0:1789181311.418153:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789181311.418175:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9990:x1876092408350976:12345-0@lo:7: 00002000:00080000:3.0:1789181311.424664:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789181311.424673:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789181311.424815:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9990:x1876092408350976:12345-0@lo:7: Request processed in 6649us (10969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.424826:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789181311.425092:0:9990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360c380 x1876092408350976/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789181327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181311.425109:0:9990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9990:1876092408350976:0@lo:7: 00000004:00080000:0.0:1789181311.425125:0:9990:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789181311.425176:0:9990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9990:1876092408351104:0@lo:5: 00000100:00100000:0.0:1789181311.425221:0:9990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181311.425300:0:9990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.425873:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408351104 00000100:00100000:2.0:1789181311.425884:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408351104 00000100:00100000:3.0:1789181311.428471:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181311.428504:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9990:x1876092408351104:12345-0@lo:5: 00002000:00080000:3.0:1789181311.429326:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789181311.429333:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1789181311.448294:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1789181311.448316:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789181311.448324:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789181311.453708:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9990:x1876092408351104:12345-0@lo:5: Request processed in 25208us (28474us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789181311.453737:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789181311.456801:0:9990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360c380 x1876092408351104/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181311.456820:0:9990:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789181311.456828:0:9990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9990:1876092408351104:0@lo:5: 00000004:00080000:1.0:1789181311.456848:0:9990:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789181311.456911:0:9990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9990:1876092408351232:0@lo:700: 00000100:00100000:1.0:1789181311.457708:0:9990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.457830:0:9990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.458474:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408351232 00000100:00100000:2.0:1789181311.458485:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408351232 00000100:00100000:2.0:1789181311.459065:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181311.459080:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9990:x1876092408351232:12345-0@lo:700: 00000100:00100000:2.0:1789181311.484630:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9990:x1876092408351232:12345-0@lo:700: Request processed in 25537us (26908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.484648:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789181311.484788:0:9990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc2756a00 x1876092408351232/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789181327 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181311.484808:0:9990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9990:1876092408351232:0@lo:700: 00000004:02000040:1.0:1789181311.487874:0:9990:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789181311.495555:0:9990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9990:1876092408351360:0@lo:5: 00000100:00100000:1.0:1789181311.495629:0:9990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.495780:0:9990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181311.496281:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408351360 00000100:00100000:0.0:1789181311.496289:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408351360 00000100:00100000:0.0:1789181311.496460:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789181311.496471:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9990:x1876092408351360:12345-0@lo:5: 00010000:00010000:2.0:1789181311.503811:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789181311.507107:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789181311.507131:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789181311.512991:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9990:x1876092408351360:12345-0@lo:5: Request processed in 16514us (17354us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789181311.513006:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789181311.515000:0:9990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc2756a00 x1876092408351360/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181327 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181311.515023:0:9990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9990:1876092408351360:0@lo:5: 00000004:00080000:1.0:1789181311.515043:0:9990:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:3.0:1789181312.136717:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1789181312.525194:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789181313.233525:0:10041:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789181313.234051:0:10041:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789181313.551589:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181313.804334:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181313.806586:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408351488:0@lo:41: 00000100:00100000:1.0:1789181313.806665:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181313.810313:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408351488 00000100:00100000:2.0:1789181313.810331:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408351488 00000100:00100000:2.0:1789181313.810396:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789181313.810407:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408351488:12345-0@lo:41: 00000004:00000024:2.0:1789181313.810447:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789181313.810549:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408351488:12345-0@lo:41: Request processed in 144us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181313.810557:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789181313.810719:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408351488:0@lo:41: 00000020:00000004:1.0:1789181314.117703:0:10089:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789181314.117713:0:10089:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1789181314.572043:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181314.620078:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181314.620150:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385230976 00000100:00100000:3.0:1789181314.620163:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385230976 00000100:00100000:3.0:1789181314.620218:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:3.0:1789181314.620227:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2392:x1876092385230976:12345-192.168.202.1@tcp:250: 00010000:00080000:3.0:1789181314.620257:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 525f5671-d737-455e-aa6e-3cb90307b925@192.168.202.1@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1789181314.620298:0:6516:0:(genops.c:1384:class_connect()) connect: client 525f5671-d737-455e-aa6e-3cb90307b925, cookie 0x76fb555283516f86 00000100:00080000:3.0:1789181314.620453:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9c1cc3925800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181314.620532:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+5:2392:x1876092385230976:12345-192.168.202.1@tcp:250: Request processed in 304us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181314.620541:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:1.0:1789181314.632361:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181314.632510:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385231104 00000100:00100000:0.0:1789181314.632521:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385231104 00000100:00100000:0.0:1789181314.632577:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:0.0:1789181314.632586:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+5:6155:x1876092385231104:12345-192.168.202.1@tcp:101: 00010000:00010000:0.0:1789181314.632603:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181314.632621:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658a800/0x76fb555283516f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7d69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181314.632650:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658a800/0x76fb555283516f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d69 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181314.632661:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658a800/0x76fb555283516f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d69 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181314.632670:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658a800, rc 0) 00000100:00100000:0.0:1789181314.632786:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+6:6155:x1876092385231104:12345-192.168.202.1@tcp:101: Request processed in 200us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181314.632794:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:3.0:1789181314.647628:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181314.647778:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385231232 00000100:00100000:1.0:1789181314.647791:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385231232 00000100:00100000:1.0:1789181314.647850:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:1.0:1789181314.647861:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+6:6155:x1876092385231232:12345-192.168.202.1@tcp:501: 00000100:00100000:1.0:1789181314.648000:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+6:6155:x1876092385231232:12345-192.168.202.1@tcp:501: Request processed in 139us (384us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181314.648008:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:1.0:1789181314.654995:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181314.655086:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385231360 00000100:00100000:3.0:1789181314.655099:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385231360 00000100:00100000:3.0:1789181314.655172:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:3.0:1789181314.655183:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+6:6155:x1876092385231360:12345-192.168.202.1@tcp:101: 00010000:00010000:3.0:1789181314.655205:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181314.655225:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e00867c00/0x76fb555283516f94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7d70 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181314.655256:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e00867c00/0x76fb555283516f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d70 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181314.655279:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e00867c00/0x76fb555283516f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d70 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181314.655310:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e00867c00, rc 0) 00000100:00100000:3.0:1789181314.655377:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+7:6155:x1876092385231360:12345-192.168.202.1@tcp:101: Request processed in 195us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181314.655384:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:3.0:1789181314.662502:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181314.662768:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385231488 00000100:00100000:2.0:1789181314.662779:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385231488 00000100:00100000:2.0:1789181314.662848:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:2.0:1789181314.662862:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+7:6155:x1876092385231488:12345-192.168.202.1@tcp:501: 00000100:00100000:2.0:1789181314.663083:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+8:6155:x1876092385231488:12345-192.168.202.1@tcp:501: Request processed in 223us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181314.663113:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:2.0:1789181314.666594:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181314.666695:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385231616 00000100:00100000:1.0:1789181314.666708:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385231616 00000100:00100000:1.0:1789181314.666807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:1.0:1789181314.666819:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+8:6155:x1876092385231616:12345-192.168.202.1@tcp:503: 00000100:00100000:1.0:1789181314.666999:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+8:6155:x1876092385231616:12345-192.168.202.1@tcp:503: Request processed in 181us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181314.667006:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:1.0:1789181314.670335:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181314.670440:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385231744 00000100:00100000:3.0:1789181314.670454:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385231744 00000100:00100000:3.0:1789181314.670526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:3.0:1789181314.670536:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+8:6174:x1876092385231744:12345-192.168.202.1@tcp:502: 00000100:00100000:3.0:1789181314.670938:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+8:6174:x1876092385231744:12345-192.168.202.1@tcp:502: Request processed in 402us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181314.670947:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:3.0:1789181314.734801:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181314.735010:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385231872 00000100:00100000:1.0:1789181314.735021:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385231872 00000100:00100000:1.0:1789181314.735076:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:1.0:1789181314.735086:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+8:6174:x1876092385231872:12345-192.168.202.1@tcp:502: 00000100:00100000:1.0:1789181314.735268:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+8:6174:x1876092385231872:12345-192.168.202.1@tcp:502: Request processed in 182us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181314.735285:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:0.0:1789181314.748333:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181314.748705:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385232000 00000100:00100000:2.0:1789181314.748716:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385232000 00000100:00100000:2.0:1789181314.748808:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:2.0:1789181314.748820:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+8:6155:x1876092385232000:12345-192.168.202.1@tcp:101: 00010000:00010000:2.0:1789181314.748839:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181314.748858:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523600/0x76fb555283516f9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7da1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181314.748889:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523600/0x76fb555283516f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da1 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181314.748913:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523600/0x76fb555283516f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da1 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181314.748922:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523600, rc 0) 00000100:00100000:2.0:1789181314.748984:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+9:6155:x1876092385232000:12345-192.168.202.1@tcp:101: Request processed in 166us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181314.748991:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:2.0:1789181314.752348:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181314.752437:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385232128 00000100:00100000:3.0:1789181314.752448:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385232128 00000100:00100000:3.0:1789181314.752518:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:3.0:1789181314.752529:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+9:6155:x1876092385232128:12345-192.168.202.1@tcp:256: 20000000:01000000:3.0:1789181314.752559:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789181314.752585:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789181314.752589:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789181314.752592:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789181314.752595:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789181314.752597:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789181314.754325:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+9:6155:x1876092385232128:12345-192.168.202.1@tcp:256: Request processed in 1783us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181314.754341:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:0.0:1789181314.764250:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181314.764404:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385232256 00000100:00100000:1.0:1789181314.764415:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385232256 00000100:00100000:1.0:1789181314.764487:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:1.0:1789181314.764498:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+9:6155:x1876092385232256:12345-192.168.202.1@tcp:101: 00010000:00010000:1.0:1789181314.764515:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181314.764533:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e021f0400/0x76fb555283516fa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7da8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181314.764565:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e021f0400/0x76fb555283516fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da8 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181314.764575:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e021f0400/0x76fb555283516fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da8 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181314.764584:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e021f0400, rc 0) 00000100:00100000:1.0:1789181314.764647:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:6155:x1876092385232256:12345-192.168.202.1@tcp:101: Request processed in 150us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181314.764656:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:1.0:1789181314.766817:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181314.766998:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385232384 00000100:00100000:2.0:1789181314.767011:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385232384 00000100:00100000:2.0:1789181314.767067:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:2.0:1789181314.767077:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+10:6155:x1876092385232384:12345-192.168.202.1@tcp:501: 00000100:00100000:2.0:1789181314.767249:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+10:6155:x1876092385232384:12345-192.168.202.1@tcp:501: Request processed in 172us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181314.767287:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:3.0:1789181314.769481:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181314.769656:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385232512 00000100:00100000:0.0:1789181314.769668:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385232512 00000100:00100000:0.0:1789181314.769770:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:0.0:1789181314.769781:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:6155:x1876092385232512:12345-192.168.202.1@tcp:503: 00000100:00100000:0.0:1789181314.770192:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:6155:x1876092385232512:12345-192.168.202.1@tcp:503: Request processed in 411us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181314.770202:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:0.0:1789181314.775695:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181314.776191:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385232640 00000100:00100000:1.0:1789181314.776203:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385232640 00000100:00100000:1.0:1789181314.776300:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:1.0:1789181314.776311:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:6183:x1876092385232640:12345-192.168.202.1@tcp:502: 00000100:00100000:1.0:1789181314.777304:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:6183:x1876092385232640:12345-192.168.202.1@tcp:502: Request processed in 988us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181314.777315:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:3.0:1789181314.780199:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181314.780953:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385232768 00000100:00100000:0.0:1789181314.780966:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385232768 00000100:00100000:0.0:1789181314.781024:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:0.0:1789181314.781037:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:6183:x1876092385232768:12345-192.168.202.1@tcp:502: 00000100:00100000:0.0:1789181314.781225:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:6183:x1876092385232768:12345-192.168.202.1@tcp:502: Request processed in 191us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181314.781233:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:3.0:1789181314.784900:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181314.784960:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181314.785780:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385232896 00000100:00100000:0.0:1789181314.785791:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385232896 00000100:00100000:0.0:1789181314.785828:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385233152 00000100:00100000:0.0:1789181314.785830:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385233152 00000100:00100000:0.0:1789181314.785859:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1789181314.785867:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1876092385232896:12345-192.168.202.1@tcp:38: 00010000:00080000:0.0:1789181314.785909:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:0.0:1789181314.785966:0:6522:0:(genops.c:1384:class_connect()) connect: client 3c4ab02e-ed68-4ee0-b458-d9073baffb59, cookie 0x76fb555283516fa9 00000004:00100000:0.0:1789181314.785992:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789181314.786241:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf23000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181314.786363:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1789181314.786370:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876092385233152:12345-192.168.202.1@tcp:38: 00010000:00080000:3.0:1789181314.786389:0:9021:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1789181314.786429:0:9021:0:(genops.c:1384:class_connect()) connect: client 3c4ab02e-ed68-4ee0-b458-d9073baffb59, cookie 0x76fb555283516fb0 00000004:00100000:3.0:1789181314.786444:0:9021:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789181314.786602:0:9021:0:(import.c:65:import_set_state_nolock()) ffff9c1cc3924800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181314.786670:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2392:x1876092385233152:12345-192.168.202.1@tcp:38: Request processed in 299us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181314.786678:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1789181314.787114:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2392:x1876092385232896:12345-192.168.202.1@tcp:38: Request processed in 1245us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181314.787121:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1789181315.340185:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408351616:0@lo:13: 00000100:00100000:2.0:1789181315.340249:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181315.340628:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408351616 00000100:00100000:1.0:1789181315.340635:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408351616 00000100:00100000:1.0:1789181315.340692:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789181315.340702:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408351616:12345-0@lo:13: 00002000:00000024:1.0:1789181315.340754:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181315.340809:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408351616:12345-0@lo:13: Request processed in 110us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181315.340815:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789181315.341157:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789181315.341185:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc2756300 x1876092408351616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181315.341203:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408351616:0@lo:13: 00000100:00100000:2.0:1789181315.341897:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181315.341909:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408351744:0@lo:13: 00000100:00100000:2.0:1789181315.341948:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181315.342118:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408351744 00000100:00100000:0.0:1789181315.342125:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408351744 00000100:00100000:0.0:1789181315.342187:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789181315.342196:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408351744:12345-0@lo:13: 00002000:00000024:0.0:1789181315.342216:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181315.342263:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408351744:12345-0@lo:13: Request processed in 68us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181315.342269:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789181315.342300:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360c700 x1876092408351744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181315.342316:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408351744:0@lo:13: 00000100:00080000:2.0:1789181315.342982:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181315.596198:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181315.790437:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181315.793775:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385233280 00000100:00100000:2.0:1789181315.793795:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385233280 00000100:00100000:1.0:1789181315.793944:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181315.793956:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1789181315.793969:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:0:x1876092385233280:12345-192.168.202.1@tcp:41: 00000004:00000024:2.0:1789181315.794018:0:9021:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181315.794033:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181315.794069:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385233024 00000100:00100000:1.0:1789181315.794074:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385233024 00000100:00100000:2.0:1789181315.794093:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:0:x1876092385233280:12345-192.168.202.1@tcp:41: Request processed in 127us (3671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181315.794101:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1789181315.794117:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385233408 00000100:00100000:2.0:1789181315.794120:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385233408 00000100:00100000:2.0:1789181315.794153:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1789181315.794160:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:6155:x1876092385233408:12345-192.168.202.1@tcp:41: 00000004:00000024:2.0:1789181315.794177:0:9021:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789181315.794217:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:6155:x1876092385233408:12345-192.168.202.1@tcp:41: Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181315.794238:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00080000:0.0:1789181315.802561:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181315.802575:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789181315.804922:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1789181315.804940:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:0:x1876092385233024:12345-192.168.202.1@tcp:41: 00000004:00000024:1.0:1789181315.805266:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789181315.805359:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:0:x1876092385233024:12345-192.168.202.1@tcp:41: Request processed in 423us (11418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181315.805368:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1789181315.814369:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181315.814585:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385233536 00000100:00100000:0.0:1789181315.814597:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385233536 00000100:00100000:0.0:1789181315.814665:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1789181315.814678:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6155:x1876092385233536:12345-192.168.202.1@tcp:40: 00000100:00100000:0.0:1789181315.814837:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6155:x1876092385233536:12345-192.168.202.1@tcp:40: Request processed in 161us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181315.814846:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1789181315.826553:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181315.826596:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181315.826625:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181315.826671:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181315.827095:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385233920 00000100:00100000:1.0:1789181315.827106:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385233920 00000100:00100000:1.0:1789181315.827178:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1789181315.827189:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6155:x1876092385233920:12345-192.168.202.1@tcp:900: 00000100:00100000:1.0:1789181315.827278:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6155:x1876092385233920:12345-192.168.202.1@tcp:900: Request processed in 91us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181315.827286:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:0.0:1789181315.827767:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385233664 00000100:00100000:0.0:1789181315.827773:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385233664 00000100:00100000:0.0:1789181315.827803:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385233792 00000100:00100000:0.0:1789181315.827806:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385233792 00000100:00100000:0.0:1789181315.827821:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1789181315.827828:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1876092385233664:12345-192.168.202.1@tcp:8: 00010000:00080000:0.0:1789181315.827858:0:8629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:0.0:1789181315.827907:0:8629:0:(genops.c:1384:class_connect()) connect: client 3c4ab02e-ed68-4ee0-b458-d9073baffb59, cookie 0x76fb555283516fb7 00002000:00100000:0.0:1789181315.827920:0:8629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3c4ab02e-ed68-4ee0-b458-d9073baffb59/ffff9c1dfaf26000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789181315.827931:0:8629:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789181315.828184:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1789181315.828191:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1876092385233792:12345-192.168.202.1@tcp:8: 00010000:00080000:3.0:1789181315.828210:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:3.0:1789181315.828231:0:8436:0:(genops.c:1384:class_connect()) connect: client 3c4ab02e-ed68-4ee0-b458-d9073baffb59, cookie 0x76fb555283516fbe 00002000:00100000:3.0:1789181315.828236:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3c4ab02e-ed68-4ee0-b458-d9073baffb59/ffff9c1cc3924000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789181315.828257:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789181315.828457:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789181315.828489:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c1cc3926000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181315.828549:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2392:x1876092385233792:12345-192.168.202.1@tcp:8: Request processed in 357us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181315.828556:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1789181315.828695:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385234048 00000100:00100000:3.0:1789181315.828701:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385234048 00000100:00100000:3.0:1789181315.828757:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:3.0:1789181315.828766:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385234048:12345-192.168.202.1@tcp:400: 00000100:00100000:3.0:1789181315.828798:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385234048:12345-192.168.202.1@tcp:400: Request processed in 33us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181315.828805:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00002000:00080000:0.0:1789181315.829356:0:8629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789181315.829381:0:8629:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf43000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181315.829415:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2392:x1876092385233664:12345-192.168.202.1@tcp:8: Request processed in 1586us (2818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181315.829422:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1789181315.833524:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181315.836564:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385234176 00000100:00100000:0.0:1789181315.836584:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385234176 00000100:00100000:0.0:1789181315.837527:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1789181315.837545:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6155:x1876092385234176:12345-192.168.202.1@tcp:33: 00000004:00080000:0.0:1789181315.862937:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25279us 00000004:00200000:1.0:1789181315.887517:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789181315.887699:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6155:x1876092385234176:12345-192.168.202.1@tcp:33: Request processed in 50153us (54180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181315.887751:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1789181316.087658:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181316.087764:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385234304 00000100:00100000:3.0:1789181316.087775:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385234304 00000100:00100000:3.0:1789181316.087849:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1789181316.087859:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6201:x1876092385234304:12345-192.168.202.1@tcp:101: 00010000:00010000:3.0:1789181316.087892:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181316.087952:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e800/0x76fb555283516fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7dd9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181316.088029:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283516fcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181316.088044:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283516fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181316.088061:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283516fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181316.088111:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789181316.088139:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181316.088162:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283516fcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181316.088193:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e800/0x76fb555283516fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dd9 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181316.088213:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283516fcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dd9 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181316.088222:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc3740800) 00010000:00010000:3.0:1789181316.088225:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181316.088228:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f600, rc 0) 00000100:00100000:3.0:1789181316.088317:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:6201:x1876092385234304:12345-192.168.202.1@tcp:101: Request processed in 459us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181316.088325:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1789181316.364576:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181316.364624:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408351872:0@lo:41: 00000100:00100000:0.0:1789181316.364750:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181316.370007:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408351872 00000100:00100000:2.0:1789181316.370306:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408351872 00000100:00100000:2.0:1789181316.370519:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789181316.370533:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408351872:12345-0@lo:41: 00000004:00000024:2.0:1789181316.370578:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789181316.370686:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408351872:12345-0@lo:41: Request processed in 157us (5964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181316.370694:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789181316.370815:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408351872:0@lo:41: 00010000:00010000:3.0:1789181316.620521:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181316.877104:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408352256:0@lo:400: 00000100:00100000:1.0:1789181316.877211:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181316.879537:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408352768:0@lo:400: 00000100:00100000:1.0:1789181316.879609:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181316.879646:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408353280:0@lo:400: 00000100:00100000:1.0:1789181316.879667:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181316.879701:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789181316.879708:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408352128:0@lo:400: 00000100:00100000:1.0:1789181316.879765:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181316.879786:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408352640:0@lo:400: 00000100:00100000:1.0:1789181316.879808:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181316.879824:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408353152:0@lo:400: 00000100:00100000:1.0:1789181316.879866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181316.880055:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408352384:0@lo:400: 00000100:00100000:3.0:1789181316.880131:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408352000:0@lo:13: 00000100:00100000:2.0:1789181316.880507:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408352256 00000100:00100000:2.0:1789181316.880515:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408352256 00000100:00100000:2.0:1789181316.880559:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408352768 00000100:00100000:2.0:1789181316.880563:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408352768 00000100:00100000:2.0:1789181316.880590:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408353280 00000100:00100000:2.0:1789181316.880593:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408353280 00000100:00100000:2.0:1789181316.880606:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408352640 00000100:00100000:2.0:1789181316.880609:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408352640 00000100:00100000:2.0:1789181316.880619:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408353152 00000100:00100000:2.0:1789181316.880622:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408353152 00000100:00100000:2.0:1789181316.880639:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181316.880648:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408352256:12345-0@lo:400: 00000100:00100000:0.0:1789181316.883735:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181316.886770:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408352896:0@lo:400: 00000100:00100000:0.0:1789181316.886844:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181316.886891:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408353408:0@lo:400: 00000100:00100000:0.0:1789181316.886915:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181316.886971:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408352384 00000100:00100000:0.0:1789181316.886979:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408352384 00000100:00100000:0.0:1789181316.887018:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789181316.887029:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408352768:12345-0@lo:400: 00000100:00100000:0.0:1789181316.887080:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408352768:12345-0@lo:400: Request processed in 54us (7472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181316.887086:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789181316.887102:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789181316.887109:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408353280:12345-0@lo:400: 00000100:00100000:0.0:1789181316.887150:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408353280:12345-0@lo:400: Request processed in 42us (7482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181316.887156:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789181316.887168:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789181316.887173:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408352640:12345-0@lo:400: 00000100:00100000:0.0:1789181316.887225:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408352640:12345-0@lo:400: Request processed in 51us (7416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181316.887232:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789181316.887257:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789181316.887271:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408353152:12345-0@lo:400: 00000100:00100000:0.0:1789181316.887299:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408353152:12345-0@lo:400: Request processed in 30us (7433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181316.887304:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789181316.887325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789181316.887331:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408352384:12345-0@lo:400: 00000100:00100000:0.0:1789181316.887362:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408352384:12345-0@lo:400: Request processed in 32us (3652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181316.887368:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789181316.887390:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181316.887396:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181316.887406:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408352896 00000100:00100000:0.0:1789181316.887410:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408352896 00000100:00100000:0.0:1789181316.887437:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408353408 00000100:00100000:0.0:1789181316.887440:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408353408 00000100:00100000:0.0:1789181316.887466:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181316.887472:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408352896:12345-0@lo:400: 00000100:00100000:0.0:1789181316.887513:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408352896:12345-0@lo:400: Request processed in 41us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181316.887519:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181316.887530:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181316.887536:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408353408:12345-0@lo:400: 00000100:00100000:0.0:1789181316.887558:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408353408:12345-0@lo:400: Request processed in 23us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181316.887564:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789181316.887576:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181316.887619:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408352384:0@lo:400: 00010000:00080000:0.0:1789181316.887642:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd136c380 x1876092408352896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181316.887654:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408352896:0@lo:400: 00010000:00080000:0.0:1789181316.887663:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc255b100 x1876092408353408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181316.887669:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789181316.887685:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408353408:0@lo:400: 00000100:00100000:0.0:1789181316.887783:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408352128 00000100:00100000:0.0:1789181316.887787:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408352128 00000100:00100000:0.0:1789181316.887814:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789181316.887820:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408352128:12345-0@lo:400: 00000100:00100000:0.0:1789181316.887853:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408352128:12345-0@lo:400: Request processed in 33us (8087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181316.887858:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789181316.887886:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408353664:0@lo:13: 00000100:00100000:0.0:1789181316.887914:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181316.887944:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408353664 00000100:00100000:0.0:1789181316.887947:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408353664 00000100:00100000:0.0:1789181316.887970:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181316.887977:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408353664:12345-0@lo:13: 00002000:00000024:0.0:1789181316.887991:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181316.888029:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408353664:12345-0@lo:13: Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181316.888036:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789181316.888060:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34f9880 x1876092408353664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181316.888084:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408353664:0@lo:13: 00000100:00100000:3.0:1789181316.889032:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181316.889072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408352512:0@lo:400: 00000100:00100000:3.0:1789181316.889103:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181316.889137:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408353024:0@lo:400: 00000100:00100000:3.0:1789181316.889159:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181316.889183:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408353024 00000100:00100000:3.0:1789181316.889187:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408353024 00000100:00100000:3.0:1789181316.889219:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181316.889226:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408353024:12345-0@lo:400: 00000100:00100000:3.0:1789181316.889271:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408353024:12345-0@lo:400: Request processed in 45us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181316.889278:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789181316.889308:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc255ad80 x1876092408353024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181316.889319:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408353024:0@lo:400: 00000100:00100000:3.0:1789181316.889325:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408353536:0@lo:400: 00000100:00100000:3.0:1789181316.889359:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181316.889378:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408353536 00000100:00100000:3.0:1789181316.889381:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408353536 00000100:00100000:3.0:1789181316.889410:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789181316.889416:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408353536:12345-0@lo:400: 00000100:00100000:3.0:1789181316.889443:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408353536:12345-0@lo:400: Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181316.889448:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789181316.889465:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789181316.889481:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc255bb80 x1876092408353536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181316.889490:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789181316.889502:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408353536:0@lo:400: 00000100:00100000:3.0:1789181316.889540:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408352512 00000100:00100000:3.0:1789181316.889544:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408352512 00000100:00100000:3.0:1789181316.889568:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789181316.889574:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408352512:12345-0@lo:400: 00000100:00100000:0.0:1789181316.889945:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408352000 00000100:00100000:0.0:1789181316.889950:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408352000 00000100:00100000:0.0:1789181316.889974:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789181316.889980:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408352000:12345-0@lo:13: 00002000:00000024:0.0:1789181316.889993:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181316.889999:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408352512:12345-0@lo:400: Request processed in 425us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181316.890012:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789181316.890022:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408352000:12345-0@lo:13: Request processed in 43us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181316.890027:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789181316.890044:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc2754e00 x1876092408352000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181316.890058:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408352000:0@lo:13: 00000100:00100000:3.0:1789181316.890079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408352512:0@lo:400: 00000100:00100000:1.0:1789181316.890133:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408353152:0@lo:400: 00010000:00080000:1.0:1789181316.890148:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd136ca80 x1876092408352768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181316.890156:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408352768:0@lo:400: 00010000:00080000:1.0:1789181316.890166:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc2559f80 x1876092408353280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181316.890173:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408353280:0@lo:400: 00000100:00100000:1.0:1789181316.890194:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408352128:0@lo:400: 00000100:00100000:1.0:1789181316.890217:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408352640:0@lo:400: 00000100:00100000:2.0:1789181316.892717:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408352256:12345-0@lo:400: Request processed in 12058us (15495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181316.892748:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789181316.902294:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408352256:0@lo:400: 00010000:00010000:3.0:1789181317.646440:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181318.284432:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181318.284594:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385234432 00000100:00100000:2.0:1789181318.284605:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385234432 00000100:00100000:2.0:1789181318.284686:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1789181318.284698:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:6253:x1876092385234432:12345-192.168.202.1@tcp:41: 00000004:00000024:2.0:1789181318.284796:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789181318.284874:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:6253:x1876092385234432:12345-192.168.202.1@tcp:41: Request processed in 178us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181318.284882:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00080000:3.0:1789181318.285541:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181318.291906:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181318.292901:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385234560 00000100:00100000:1.0:1789181318.292915:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385234560 00000100:00100000:1.0:1789181318.293000:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1789181318.293012:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6253:x1876092385234560:12345-192.168.202.1@tcp:41: 00000100:00080000:3.0:1789181318.294002:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:1.0:1789181318.294245:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181318.294338:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6253:x1876092385234560:12345-192.168.202.1@tcp:41: Request processed in 1326us (2439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181318.294347:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1789181318.310076:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181318.310766:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385234688 00000100:00100000:3.0:1789181318.310780:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385234688 00000100:00100000:3.0:1789181318.311000:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1789181318.311013:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6253:x1876092385234688:12345-192.168.202.1@tcp:13: 00002000:00000024:3.0:1789181318.311135:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789181318.311324:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181318.311694:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6253:x1876092385234688:12345-192.168.202.1@tcp:13: Request processed in 680us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181318.311704:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1789181318.320597:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181318.320988:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385234816 00000100:00100000:1.0:1789181318.321001:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385234816 00000100:00100000:1.0:1789181318.321112:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1789181318.321126:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6253:x1876092385234816:12345-192.168.202.1@tcp:13: 00002000:00000024:1.0:1789181318.321204:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181318.321306:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:6253:x1876092385234816:12345-192.168.202.1@tcp:13: Request processed in 183us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181318.321315:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00080000:0.0:1789181318.321605:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789181318.670591:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181318.923934:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181318.923962:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408353792:0@lo:41: 00000100:00100000:2.0:1789181318.924041:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181318.924125:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408353792 00000100:00100000:2.0:1789181318.924133:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408353792 00000100:00100000:2.0:1789181318.924183:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789181318.924192:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408353792:12345-0@lo:41: 00000004:00000024:2.0:1789181318.924218:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789181318.924266:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408353792:12345-0@lo:41: Request processed in 74us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181318.924273:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789181318.924322:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408353792:0@lo:41: 00010000:00010000:1.0:1789181319.694760:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789181319.954138:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000100:00100000:3.0:1789181320.460525:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181320.460556:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408353920:0@lo:13: 00000100:00100000:3.0:1789181320.460663:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181320.461601:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408354048:0@lo:13: 00000100:00100000:3.0:1789181320.461650:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181320.461921:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408353920 00000100:00100000:2.0:1789181320.461934:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408353920 00000100:00100000:2.0:1789181320.461995:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408354048 00000100:00100000:2.0:1789181320.461998:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408354048 00000100:00080000:0.0:1789181320.462146:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181320.462186:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789181320.469221:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408353920:12345-0@lo:13: 00002000:00000024:2.0:1789181320.469267:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181320.469398:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408353920:12345-0@lo:13: Request processed in 7202us (8734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181320.469407:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789181320.469452:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181320.469475:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408354048:12345-0@lo:13: 00002000:00000024:2.0:1789181320.469488:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181320.469515:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408354048:12345-0@lo:13: Request processed in 43us (7864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181320.469521:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789181320.470066:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34f9f80 x1876092408354048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181320.470101:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408354048:0@lo:13: 00010000:00080000:3.0:1789181320.470126:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5ddf80 x1876092408353920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181320.470138:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408353920:0@lo:13: 00010000:00010000:3.0:1789181320.718106:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789181320.976950:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000001:00100000:1.0:1789181320.978709:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000100:00100000:0.0:1789181321.065073:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181321.065122:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181321.065155:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181321.065177:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181321.067473:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181321.067532:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385234944 00000100:00100000:0.0:1789181321.067542:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385234944 00000100:00100000:0.0:1789181321.067596:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:0.0:1789181321.067606:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:2393:x1876092385234944:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1789181321.067683:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:2393:x1876092385234944:12345-192.168.202.1@tcp:400: Request processed in 78us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181321.067701:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:0.0:1789181321.067762:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385235200 00000100:00100000:0.0:1789181321.067767:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385235200 00000100:00100000:0.0:1789181321.067804:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385235072 00000100:00100000:0.0:1789181321.067807:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385235072 00000100:00100000:0.0:1789181321.067937:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1789181321.067947:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385235200:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1789181321.067978:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385235200:12345-192.168.202.1@tcp:400: Request processed in 34us (2855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181321.067984:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1789181321.067996:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1789181321.068001:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385235072:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1789181321.068019:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385235072:12345-192.168.202.1@tcp:400: Request processed in 18us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181321.068025:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1789181321.068040:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385235456 00000100:00100000:0.0:1789181321.068043:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385235456 00000100:00100000:0.0:1789181321.068066:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385235328 00000100:00100000:0.0:1789181321.068068:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385235328 00000100:00100000:0.0:1789181321.068098:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1789181321.068104:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385235456:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1789181321.068125:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385235456:12345-192.168.202.1@tcp:400: Request processed in 22us (2970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181321.068130:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1789181321.069055:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1789181321.069069:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385235328:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1789181321.069137:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385235328:12345-192.168.202.1@tcp:400: Request processed in 71us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181321.069976:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00080000:0.0:1789181321.072017:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789181321.072025:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181321.072029:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181321.072031:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1789181321.413543:0:10187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789181321.490068:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408354176:0@lo:41: 00000100:00100000:2.0:1789181321.490157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181321.490242:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408354176 00000100:00100000:2.0:1789181321.490250:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408354176 00000100:00100000:2.0:1789181321.490295:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789181321.490305:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408354176:12345-0@lo:41: 00000004:00000024:2.0:1789181321.490340:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789181321.490386:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408354176:12345-0@lo:41: Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181321.490393:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789181321.490460:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408354176:0@lo:41: 00010000:00010000:1.0:1789181321.743102:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181321.998060:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408354304:0@lo:400: 00000100:00100000:1.0:1789181321.998146:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181321.998197:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408354816:0@lo:400: 00000100:00100000:1.0:1789181321.998238:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181321.998256:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408355328:0@lo:400: 00000100:00100000:1.0:1789181321.998276:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181321.998304:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789181321.998310:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408354688:0@lo:400: 00000100:00100000:1.0:1789181321.998333:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181321.998351:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408355200:0@lo:400: 00000100:00100000:1.0:1789181321.998372:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181321.998388:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408355712:0@lo:400: 00000100:00100000:1.0:1789181321.998419:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181321.998456:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408354304 00000100:00100000:1.0:1789181321.998465:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408354304 00000100:00100000:1.0:1789181321.998509:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789181321.998519:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408354304:12345-0@lo:400: 00000100:00100000:1.0:1789181321.998572:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408354304:12345-0@lo:400: Request processed in 55us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181321.998579:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789181321.998612:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408354816 00000100:00100000:1.0:1789181321.998616:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408354816 00000100:00100000:1.0:1789181321.998646:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408355328 00000100:00100000:1.0:1789181321.998649:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408355328 00000100:00100000:1.0:1789181321.998666:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789181321.998671:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408354816:12345-0@lo:400: 00000100:00100000:1.0:1789181321.998704:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408354816:12345-0@lo:400: Request processed in 32us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181321.998709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789181321.998744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789181321.998758:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408355328:12345-0@lo:400: 00000100:00100000:1.0:1789181321.998787:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408355328:12345-0@lo:400: Request processed in 31us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181321.998793:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789181321.998812:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408354688 00000100:00100000:1.0:1789181321.998815:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408354688 00000100:00100000:1.0:1789181321.998840:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789181321.998847:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408354688:12345-0@lo:400: 00000100:00100000:1.0:1789181321.998877:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408354688:12345-0@lo:400: Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181321.998883:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789181321.998900:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408355200 00000100:00100000:1.0:1789181321.998903:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408355200 00000100:00100000:1.0:1789181321.998923:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408355712 00000100:00100000:1.0:1789181321.998926:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408355712 00000100:00100000:1.0:1789181321.998946:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789181321.998953:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408355200:12345-0@lo:400: 00000100:00100000:1.0:1789181321.998983:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408355200:12345-0@lo:400: Request processed in 31us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181321.998989:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789181321.999000:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181321.999006:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408355712:12345-0@lo:400: 00000100:00100000:1.0:1789181321.999032:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408355712:12345-0@lo:400: Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181321.999038:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181321.999090:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408354688:0@lo:400: 00010000:00080000:1.0:1789181321.999103:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dca80 x1876092408355200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181321.999120:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408355200:0@lo:400: 00010000:00080000:1.0:1789181321.999130:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5df480 x1876092408355712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181321.999138:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408355712:0@lo:400: 00000100:00100000:1.0:1789181321.999145:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408354304:0@lo:400: 00000100:00100000:1.0:1789181321.999152:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408354816:0@lo:400: 00000100:00100000:1.0:1789181321.999158:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408355328:0@lo:400: 00000100:00100000:0.0:1789181321.999554:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408354432:0@lo:400: 00000100:00100000:0.0:1789181321.999601:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181321.999630:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408354944:0@lo:400: 00000100:00100000:0.0:1789181321.999653:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181321.999663:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408355456:0@lo:400: 00000100:00100000:0.0:1789181321.999699:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181321.999714:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789181321.999720:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408354560:0@lo:400: 00000100:00100000:0.0:1789181321.999760:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181321.999771:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408355072:0@lo:400: 00000100:00100000:0.0:1789181321.999789:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181321.999821:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408355584:0@lo:400: 00000100:00100000:0.0:1789181321.999842:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181321.999870:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408354432 00000100:00100000:0.0:1789181321.999875:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408354432 00000100:00100000:0.0:1789181321.999899:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408354944 00000100:00100000:0.0:1789181321.999901:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408354944 00000100:00100000:0.0:1789181321.999913:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408355456 00000100:00100000:0.0:1789181321.999916:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408355456 00000100:00100000:0.0:1789181321.999936:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408354560 00000100:00100000:0.0:1789181321.999938:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408354560 00000100:00100000:0.0:1789181321.999949:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789181321.999956:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408354432:12345-0@lo:400: 00000100:00100000:0.0:1789181321.999996:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408354432:12345-0@lo:400: Request processed in 41us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181322.000002:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789181322.000015:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789181322.000021:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408354944:12345-0@lo:400: 00000100:00100000:0.0:1789181322.000046:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408354944:12345-0@lo:400: Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181322.000051:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789181322.000062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789181322.000081:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408355456:12345-0@lo:400: 00000100:00100000:0.0:1789181322.000106:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408355456:12345-0@lo:400: Request processed in 39us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181322.000111:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789181322.000121:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789181322.000127:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408354560:12345-0@lo:400: 00000100:00100000:0.0:1789181322.000149:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408354560:12345-0@lo:400: Request processed in 23us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181322.000154:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789181322.000169:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408355072 00000100:00100000:0.0:1789181322.000172:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408355072 00000100:00100000:0.0:1789181322.000185:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408355584 00000100:00100000:0.0:1789181322.000187:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408355584 00000100:00100000:0.0:1789181322.000197:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789181322.000203:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408355072:12345-0@lo:400: 00000100:00100000:0.0:1789181322.000236:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408355072:12345-0@lo:400: Request processed in 33us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181322.000242:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789181322.000252:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789181322.000258:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408355584:12345-0@lo:400: 00000100:00100000:0.0:1789181322.000295:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408355584:12345-0@lo:400: Request processed in 37us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181322.000301:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789181322.000322:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789181322.000327:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181322.000329:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181322.000375:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408354560:0@lo:400: 00010000:00080000:0.0:1789181322.000387:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dd500 x1876092408355072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181322.000396:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408355072:0@lo:400: 00010000:00080000:0.0:1789181322.000406:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dc380 x1876092408355584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181322.000413:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408355584:0@lo:400: 00000100:00100000:0.0:1789181322.000422:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408354432:0@lo:400: 00010000:00080000:0.0:1789181322.000431:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dd180 x1876092408354944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181322.000438:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408354944:0@lo:400: 00010000:00080000:0.0:1789181322.000446:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5de680 x1876092408355456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181322.000464:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408355456:0@lo:400: 00000100:00100000:1.0:1789181322.001335:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408355968:0@lo:13: 00000100:00100000:1.0:1789181322.001383:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181322.001497:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181322.001511:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408355840:0@lo:13: 00000100:00100000:2.0:1789181322.001539:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181322.002058:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408355968 00000100:00100000:0.0:1789181322.002074:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408355968 00000100:00100000:0.0:1789181322.002105:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408355840 00000100:00100000:0.0:1789181322.002108:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408355840 00000100:00100000:0.0:1789181322.002122:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789181322.002129:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408355968:12345-0@lo:13: 00002000:00000024:0.0:1789181322.002153:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181322.002208:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408355968:12345-0@lo:13: Request processed in 79us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181322.002214:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789181322.002229:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181322.002235:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408355840:12345-0@lo:13: 00002000:00000024:0.0:1789181322.002245:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181322.002280:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408355840:12345-0@lo:13: Request processed in 45us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181322.002286:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789181322.002366:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd136ca80 x1876092408355968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181322.002382:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408355968:0@lo:13: 00010000:00080000:3.0:1789181322.002452:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093d500 x1876092408355840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181322.002463:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408355840:0@lo:13: 00000001:00100000:2.0:1789181322.004122:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00010000:00010000:2.0:1789181322.766429:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181323.788180:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181324.044020:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181324.045505:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408356096:0@lo:41: 00000100:00100000:0.0:1789181324.045600:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181324.045796:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408356096 00000100:00100000:3.0:1789181324.045805:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408356096 00000100:00100000:3.0:1789181324.045902:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789181324.045911:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408356096:12345-0@lo:41: 00000004:00000024:3.0:1789181324.045945:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789181324.045988:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408356096:12345-0@lo:41: Request processed in 78us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181324.045994:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789181324.046077:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408356096:0@lo:41: 00010000:00010000:2.0:1789181324.819259:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181325.587790:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408356224:0@lo:13: 00000100:00100000:3.0:1789181325.587864:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.587933:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181325.587941:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408356352:0@lo:13: 00000100:00100000:3.0:1789181325.587965:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181325.588058:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408356224 00000100:00100000:2.0:1789181325.588069:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408356224 00000100:00100000:2.0:1789181325.588126:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408356352 00000100:00100000:2.0:1789181325.588130:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408356352 00000100:00100000:2.0:1789181325.588148:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181325.588156:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408356224:12345-0@lo:13: 00002000:00000024:2.0:1789181325.588187:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181325.588232:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408356224:12345-0@lo:13: Request processed in 77us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181325.588239:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181325.588256:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789181325.588261:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408356352:12345-0@lo:13: 00002000:00000024:2.0:1789181325.588269:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181325.588289:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408356352:12345-0@lo:13: Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181325.588294:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789181325.588504:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181325.588533:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34f9180 x1876092408356352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181325.588552:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408356352:0@lo:13: 00010000:00080000:3.0:1789181325.588562:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34fa300 x1876092408356224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181325.588585:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408356224:0@lo:13: 00010000:00010000:3.0:1789181325.843861:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789181325.884678:0:10334:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbcf26dc0 20000000:00000080:3.0:1789181325.884697:0:10334:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c1dff825400 uarg=0000000000000000 20000000:01000000:3.0:1789181325.884765:0:10334:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789181325.884768:0:10334:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789181325.884771:0:10334:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789181325.884776:0:10334:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789181325.884781:0:10334:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789181325.884840:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789181325.884843:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789181325.885695:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1789181325.886238:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1789181325.886275:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1789181325.886292:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1789181325.886308:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789181325.886311:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789181325.886900:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1789181325.887105:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1789181325.887141:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1789181325.887159:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1789181325.887170:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789181325.887172:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789181325.887466:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1789181325.888087:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1789181325.888115:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1789181325.888131:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1789181325.888143:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789181325.888144:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789181325.888586:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1789181325.888925:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1789181325.888951:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1789181325.888970:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1789181325.888983:0:10334:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789181325.888985:0:10334:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789181325.889304:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1789181325.889447:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1789181325.889484:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1789181325.889505:0:10334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:0.0:1789181325.889521:0:10334:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789181325.889542:0:10334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889563:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516e6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e67 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889572:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e91 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889579:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1523200/0x76fb555283516ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ed0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889586:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1522e00/0x76fb555283516ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ede expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889604:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e00866600/0x76fb555283516ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516eec expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889611:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516f0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516f08 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889618:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1522200/0x76fb555283516f39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516f32 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889625:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e00867e00/0x76fb555283516f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516f4e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889631:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e00867400/0x76fb555283516f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516f78 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889641:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658a800/0x76fb555283516f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d69 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889648:0:10334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e00867c00/0x76fb555283516f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d70 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889656:0:10334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889700:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e00867c00/0x76fb555283516f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d70 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.889718:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e00867c00/0x76fb555283516f94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d70 expref: 9 pid: 6513 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.889890:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408356480:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181325.890043:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658a800/0x76fb555283516f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d69 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.890052:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1dc658a800/0x76fb555283516f8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d69 expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.890060:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408356608:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181325.890093:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e00867400/0x76fb555283516f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516f78 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.890101:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1e00867400/0x76fb555283516f7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516f78 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.890109:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2757b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408356736:0@lo:104: 00000100:00100000:0.0:1789181325.890152:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181325.890192:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e00867e00/0x76fb555283516f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516f4e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.890200:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1e00867e00/0x76fb555283516f55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516f4e expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.890207:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408356864:0@lo:104: 00000100:00100000:0.0:1789181325.890228:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181325.890245:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1522200/0x76fb555283516f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516f32 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.890253:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1522200/0x76fb555283516f39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516f32 expref: 23 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.890269:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408356992:0@lo:104: 00000100:00100000:0.0:1789181325.890290:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181325.890307:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516f08 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.890316:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516f0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516f08 expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.890323:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357120:0@lo:104: 00000100:00100000:0.0:1789181325.890342:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181325.890370:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e00866600/0x76fb555283516ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516eec expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.890378:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1e00866600/0x76fb555283516ef3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516eec expref: 23 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.890386:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357248:0@lo:104: 00010000:00010000:0.0:1789181325.890413:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1522e00/0x76fb555283516ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516ede expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.890420:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1522e00/0x76fb555283516ee5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516ede expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.890428:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357376:0@lo:104: 00010000:00010000:0.0:1789181325.890453:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1523200/0x76fb555283516ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516ed0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.890461:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1523200/0x76fb555283516ed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516ed0 expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.890488:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357504:0@lo:104: 00010000:00010000:0.0:1789181325.890526:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516e91 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.890534:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516e91 expref: 23 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.890542:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357632:0@lo:104: 00010000:00010000:0.0:1789181325.890566:0:10334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516e6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516e67 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.890572:0:10334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516e6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516e67 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.890579:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357760:0@lo:104: 00000100:00100000:0.0:1789181325.890596:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7249780 going to sleep for 11 seconds 00000100:00100000:3.0:1789181325.890674:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789181325.890693:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.890705:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.890713:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.890721:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.890758:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.890767:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408356736 00000100:00100000:3.0:1789181325.890774:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408356736 00000100:00100000:3.0:1789181325.890809:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408356864 00000100:00100000:3.0:1789181325.890813:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408356864 00000100:00100000:3.0:1789181325.890823:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408356992 00000100:00100000:3.0:1789181325.890826:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408356992 00000100:00100000:3.0:1789181325.890834:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408357120 00000100:00100000:3.0:1789181325.890837:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408357120 00000100:00100000:3.0:1789181325.890856:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408357248 00000100:00100000:3.0:1789181325.890859:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408357248 00000100:00100000:3.0:1789181325.890867:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408357376 00000100:00100000:3.0:1789181325.890868:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408357376 00000100:00100000:3.0:1789181325.890876:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408357504 00000100:00100000:3.0:1789181325.890879:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408357504 00000100:00100000:3.0:1789181325.890888:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408357632 00000100:00100000:3.0:1789181325.890890:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408357632 00000100:00100000:3.0:1789181325.890897:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408357760 00000100:00100000:3.0:1789181325.890899:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408357760 00000100:00100000:3.0:1789181325.890911:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789181325.890919:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+11:10334:x1876092408356736:12345-0@lo:104: 00010000:00010000:3.0:1789181325.890932:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.890987:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181325.890993:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+11:10334:x1876092408356736:12345-0@lo:104: Request processed in 75us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.891000:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789181325.891018:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789181325.891045:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2754e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+10:10334:x1876092408356864:12345-0@lo:104: 00010000:00010000:3.0:1789181325.891054:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891087:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789181325.891092:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2754e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+10:10334:x1876092408356864:12345-0@lo:104: Request processed in 69us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.891098:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789181325.891110:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181325.891115:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+9:10334:x1876092408356992:12345-0@lo:104: 00010000:00010000:3.0:1789181325.891129:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891158:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789181325.891163:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+9:10334:x1876092408356992:12345-0@lo:104: Request processed in 48us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.891169:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181325.891181:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789181325.891186:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1df9d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+8:10334:x1876092408357120:12345-0@lo:104: 00010000:00010000:3.0:1789181325.891192:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891217:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789181325.891221:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1df9d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+8:10334:x1876092408357120:12345-0@lo:104: Request processed in 37us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.891226:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789181325.891255:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181325.891260:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+7:10334:x1876092408357248:12345-0@lo:104: 00010000:00010000:3.0:1789181325.891266:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891287:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789181325.891291:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+7:10334:x1876092408357248:12345-0@lo:104: Request processed in 32us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.891296:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181325.891308:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789181325.891313:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+6:10334:x1876092408357376:12345-0@lo:104: 00010000:00010000:3.0:1789181325.891326:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891353:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789181325.891358:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+6:10334:x1876092408357376:12345-0@lo:104: Request processed in 45us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.891364:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789181325.891376:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181325.891382:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+5:10334:x1876092408357504:12345-0@lo:104: 00010000:00010000:3.0:1789181325.891388:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891411:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1789181325.891416:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+5:10334:x1876092408357504:12345-0@lo:104: Request processed in 35us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.891421:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181325.891432:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181325.891438:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:10334:x1876092408357632:12345-0@lo:104: 00010000:00010000:3.0:1789181325.891445:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891469:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1789181325.891473:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:10334:x1876092408357632:12345-0@lo:104: Request processed in 37us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.891479:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181325.891490:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789181325.891496:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:10334:x1876092408357760:12345-0@lo:104: 00010000:00010000:3.0:1789181325.891510:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891536:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1789181325.891541:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:10334:x1876092408357760:12345-0@lo:104: Request processed in 46us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.891546:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789181325.891577:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1789181325.891583:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891590:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e00866400 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181325.891594:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891602:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181325.891610:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181325.891616:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181325.891647:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891654:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181325.891674:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891680:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e00866400/0x76fb555283516f78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f7f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891701:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1789181325.891704:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891709:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e00866000 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181325.891712:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891719:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181325.891748:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181325.891753:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181325.891767:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891772:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181325.891778:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891784:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e00866000/0x76fb555283516f4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891793:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1789181325.891796:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891812:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658aa00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181325.891815:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891821:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181325.891828:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181325.891834:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181325.891847:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891852:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181325.891866:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891872:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658aa00/0x76fb555283516f32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f39 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891882:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789181325.891885:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891891:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a400 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181325.891894:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891910:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181325.891917:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181325.891922:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181325.891936:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891942:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181325.891947:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891953:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a400/0x76fb555283516f08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516f0f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891961:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789181325.891964:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891970:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f1200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181325.891972:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.891979:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181325.891984:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181325.891996:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181325.892009:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892014:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181325.892019:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892025:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283516eec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ef3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892048:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789181325.892051:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892056:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e00867800 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181325.892059:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892065:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181325.892071:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181325.892077:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181325.892089:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892094:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181325.892104:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892111:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e00867800/0x76fb555283516ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ee5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892120:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789181325.892122:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892128:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e00867600 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181325.892130:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892137:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181325.892143:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181325.892148:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181325.892175:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892181:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181325.892187:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892192:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e00867600/0x76fb555283516ed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516ed7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892201:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181325.892209:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892214:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e00866c00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181325.892217:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892224:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181325.892230:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181325.892235:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181325.892248:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892254:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181325.892258:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892264:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e00866c00/0x76fb555283516e91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e98 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892272:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181325.892275:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892281:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522800 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181325.892283:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892300:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181325.892307:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181325.892312:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181325.892326:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892332:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181325.892336:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892343:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283516e67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e6e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.892370:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181325.892372:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181325.892374:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181325.892386:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181325.892407:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408357888:0@lo:103: 00000100:00100000:3.0:1789181325.892453:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.892489:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408358400:0@lo:103: 00000100:00100000:3.0:1789181325.892512:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.892528:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408358912:0@lo:103: 00000100:00100000:3.0:1789181325.892546:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.892565:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789181325.892578:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408358016:0@lo:103: 00000100:00100000:3.0:1789181325.892606:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.892624:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408358528:0@lo:103: 00000100:00100000:3.0:1789181325.892642:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.892665:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408358144:0@lo:103: 00000100:00100000:3.0:1789181325.892684:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.892694:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408358656:0@lo:103: 00000100:00100000:3.0:1789181325.892710:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.892742:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789181325.892749:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408358272:0@lo:103: 00000100:00100000:3.0:1789181325.892770:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.892780:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408358784:0@lo:103: 00000100:00100000:3.0:1789181325.892797:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181325.892822:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408357888 00000100:00100000:3.0:1789181325.892829:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408357888 00010000:00010000:3.0:1789181325.892857:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e00867400/0x76fb555283516f7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516f78 expref: 24 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181325.892878:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408358400 00000100:00100000:3.0:1789181325.892881:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408358400 00010000:00010000:3.0:1789181325.892891:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e00866600/0x76fb555283516ef3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516eec expref: 25 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181325.892901:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408358912 00000100:00100000:3.0:1789181325.892903:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408358912 00010000:00010000:3.0:1789181325.892913:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516e6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516e67 expref: 26 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181325.892923:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408358016 00000100:00100000:3.0:1789181325.892931:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408358016 00010000:00010000:3.0:1789181325.892944:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e00867e00/0x76fb555283516f55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516f4e expref: 27 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181325.892956:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408358528 00000100:00100000:3.0:1789181325.892959:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408358528 00010000:00010000:3.0:1789181325.892968:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1522e00/0x76fb555283516ee5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516ede expref: 28 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181325.892978:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408358144 00000100:00100000:3.0:1789181325.892981:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408358144 00010000:00010000:3.0:1789181325.892990:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1522200/0x76fb555283516f39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516f32 expref: 29 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181325.893000:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408358656 00000100:00100000:3.0:1789181325.893002:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408358656 00010000:00010000:3.0:1789181325.893011:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1523200/0x76fb555283516ed7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516ed0 expref: 30 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181325.893021:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408358272 00000100:00100000:3.0:1789181325.893024:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408358272 00010000:00010000:3.0:1789181325.893046:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516f0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516f08 expref: 31 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181325.893056:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408358784 00000100:00100000:3.0:1789181325.893059:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408358784 00010000:00010000:3.0:1789181325.893069:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516e91 expref: 32 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181325.893082:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789181325.893090:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+32:3645:x1876092408357888:12345-0@lo:103: 00010000:00010000:3.0:1789181325.893102:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181325.893115:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e00867400/0x76fb555283516f7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516f78 expref: 32 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893125:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e00867400/0x76fb555283516f7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516f78 expref: 32 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893144:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181325.893183:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+32:3645:x1876092408357888:12345-0@lo:103: Request processed in 94us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.893191:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789181325.893230:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789181325.893236:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+31:3645:x1876092408358400:12345-0@lo:103: 00010000:00010000:3.0:1789181325.893244:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181325.893248:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e00866600/0x76fb555283516ef3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516eec expref: 31 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893256:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e00866600/0x76fb555283516ef3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516eec expref: 31 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893266:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181325.893286:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+31:3645:x1876092408358400:12345-0@lo:103: Request processed in 50us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.893292:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789181325.893305:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181325.893310:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+30:3645:x1876092408358912:12345-0@lo:103: 00010000:00010000:3.0:1789181325.893317:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181325.893321:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516e6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516e67 expref: 30 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893340:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516e6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516e67 expref: 30 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893350:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181325.893374:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+30:3645:x1876092408358912:12345-0@lo:103: Request processed in 64us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.893380:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181325.893394:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789181325.893399:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+29:3645:x1876092408358016:12345-0@lo:103: 00010000:00010000:3.0:1789181325.893405:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181325.893409:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e00867e00/0x76fb555283516f55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516f4e expref: 29 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893417:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e00867e00/0x76fb555283516f55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516f4e expref: 29 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893427:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181325.893447:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+29:3645:x1876092408358016:12345-0@lo:103: Request processed in 48us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.893452:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789181325.893464:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181325.893470:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+28:3645:x1876092408358528:12345-0@lo:103: 00010000:00010000:3.0:1789181325.893476:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181325.893480:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1522e00/0x76fb555283516ee5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516ede expref: 28 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893488:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1522e00/0x76fb555283516ee5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516ede expref: 28 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893503:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181325.893526:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+28:3645:x1876092408358528:12345-0@lo:103: Request processed in 57us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.893532:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181325.893544:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789181325.893550:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+27:3643:x1876092408358144:12345-0@lo:103: 00010000:00010000:3.0:1789181325.893558:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181325.893562:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1522200/0x76fb555283516f39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516f32 expref: 27 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893570:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1522200/0x76fb555283516f39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516f32 expref: 27 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893578:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181325.893605:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+27:3643:x1876092408358144:12345-0@lo:103: Request processed in 55us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.893611:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789181325.893624:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181325.893631:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+26:3643:x1876092408358656:12345-0@lo:103: 00010000:00010000:3.0:1789181325.893638:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181325.893642:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1523200/0x76fb555283516ed7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516ed0 expref: 26 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893649:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1523200/0x76fb555283516ed7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516ed0 expref: 26 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893657:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181325.893685:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+26:3643:x1876092408358656:12345-0@lo:103: Request processed in 55us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.893691:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181325.893702:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181325.893708:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+25:3643:x1876092408358272:12345-0@lo:103: 00010000:00010000:3.0:1789181325.893715:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181325.893719:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516f0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516f08 expref: 25 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893750:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516f0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516f08 expref: 25 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893760:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181325.893781:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+25:3643:x1876092408358272:12345-0@lo:103: Request processed in 73us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.893787:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181325.893812:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789181325.893817:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408358784:12345-0@lo:103: 00010000:00010000:3.0:1789181325.893824:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181325.893828:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516e91 expref: 24 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893836:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516e91 expref: 24 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.893845:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181325.893864:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408358784:12345-0@lo:103: Request processed in 47us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181325.893870:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789181325.893926:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408358272:0@lo:103: 00000100:00100000:3.0:1789181325.893934:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408358784:0@lo:103: 00000100:00100000:3.0:1789181325.893940:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408358144:0@lo:103: 00000100:00100000:3.0:1789181325.893946:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408358656:0@lo:103: 00000100:00100000:3.0:1789181325.893975:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408358016:0@lo:103: 00000100:00100000:3.0:1789181325.893981:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408358528:0@lo:103: 00000100:00100000:3.0:1789181325.893987:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408357888:0@lo:103: 00000100:00100000:3.0:1789181325.893993:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408358400:0@lo:103: 00000100:00100000:3.0:1789181325.893999:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408358912:0@lo:103: 00010000:00010000:0.0:1789181325.894124:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e00867400/0x76fb555283516f7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516f78 expref: 23 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.894138:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2757b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408356736:0@lo:104: 00010000:00010000:0.0:1789181325.894146:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e00867e00/0x76fb555283516f55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516f4e expref: 22 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.894153:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408356864:0@lo:104: 00010000:00010000:0.0:1789181325.894160:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1522200/0x76fb555283516f39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516f32 expref: 21 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.894178:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408356992:0@lo:104: 00010000:00010000:0.0:1789181325.894189:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523c00/0x76fb555283516f0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516f08 expref: 20 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.894196:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357120:0@lo:104: 00010000:00010000:0.0:1789181325.894203:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e00866600/0x76fb555283516ef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516eec expref: 19 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.894210:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357248:0@lo:104: 00010000:00010000:0.0:1789181325.894217:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1522e00/0x76fb555283516ee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516ede expref: 18 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.894224:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357376:0@lo:104: 00010000:00010000:0.0:1789181325.894231:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523200/0x76fb555283516ed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516ed0 expref: 17 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.894238:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357504:0@lo:104: 00010000:00010000:0.0:1789181325.894245:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658b400/0x76fb555283516e98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516e91 expref: 16 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.894252:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357632:0@lo:104: 00010000:00010000:0.0:1789181325.894259:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516e6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516e67 expref: 15 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.894266:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408357760:0@lo:104: 00000100:00100000:0.0:1789181325.919230:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181325.919293:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408356480:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181325.919307:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2756d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10334:1876092408356608:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181325.919373:0:10334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181325.919575:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181325.919702:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385235584 00000100:00100000:1.0:1789181325.919711:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385235584 00000100:00100000:3.0:1789181325.919762:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385235712 00000100:00100000:3.0:1789181325.919767:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385235712 00010000:00010000:1.0:1789181325.919774:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e00867c00/0x76fb555283516f94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d70 expref: 11 pid: 6513 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.919779:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658a800/0x76fb555283516f8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d69 expref: 11 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181325.919935:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1789181325.919946:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:525f5671-d737-455e-aa6e-3cb90307b925+11:2394:x1876092385235584:12345-192.168.202.1@tcp:103: 00010000:00010000:1.0:1789181325.919975:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181325.919982:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e00867c00/0x76fb555283516f94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d70 expref: 11 pid: 6513 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.919994:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e00867c00/0x76fb555283516f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d70 expref: 11 pid: 6513 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920026:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e00867c00/0x76fb555283516f94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d70 expref: 11 pid: 6513 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920052:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181325.920322:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385235584:12345-192.168.202.1@tcp:103: Request processed in 377us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181325.920329:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1789181325.920347:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1789181325.920353:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:525f5671-d737-455e-aa6e-3cb90307b925+9:2393:x1876092385235712:12345-192.168.202.1@tcp:103: 00010000:00010000:1.0:1789181325.920361:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181325.920365:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc658a800/0x76fb555283516f8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d69 expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920373:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658a800/0x76fb555283516f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d69 expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920382:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658a800/0x76fb555283516f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7d69 expref: 9 pid: 6515 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920393:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920400:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920415:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920422:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920433:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920440:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920446:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181325.920450:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920457:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920485:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181325.920495:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181325.920514:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:525f5671-d737-455e-aa6e-3cb90307b925+8:2393:x1876092385235712:12345-192.168.202.1@tcp:103: Request processed in 161us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181325.920520:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00010000:00010000:3.0:1789181325.926327:0:10334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.926346:0:10334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181325.926379:0:10334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658a600/0x76fb555283516fd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181326.183473:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181326.183522:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181326.183560:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181326.183596:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181326.183630:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385236096 00000100:00100000:0.0:1789181326.183640:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385236096 00000100:00100000:2.0:1789181326.183652:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385235840 00000100:00100000:2.0:1789181326.183656:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385235840 00000100:00100000:2.0:1789181326.183695:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385235968 00000100:00100000:0.0:1789181326.183696:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385236224 00000100:00100000:2.0:1789181326.183698:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385235968 00000100:00100000:0.0:1789181326.183698:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385236224 00000100:00100000:2.0:1789181326.183719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:0.0:1789181326.183719:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1789181326.183753:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385235840:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1789181326.183753:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385236096:12345-192.168.202.1@tcp:400: 00000100:00100000:1.0:1789181326.183848:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1789181326.183858:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385236224:12345-192.168.202.1@tcp:400: 00000100:00100000:0.0:1789181326.183921:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385236096:12345-192.168.202.1@tcp:400: Request processed in 167us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181326.183929:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00080000:0.0:1789181326.183952:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181326.183956:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789181326.183958:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181326.183960:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181326.183974:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1789181326.183981:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385235968:12345-192.168.202.1@tcp:400: 00000100:00100000:2.0:1789181326.184349:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385235840:12345-192.168.202.1@tcp:400: Request processed in 597us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181326.184357:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1789181326.186361:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385236224:12345-192.168.202.1@tcp:400: Request processed in 2495us (2754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181326.186372:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1789181326.187132:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385235968:12345-192.168.202.1@tcp:400: Request processed in 3147us (3566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181326.187143:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1789181326.606657:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408359040:0@lo:41: 00000100:00100000:3.0:1789181326.606762:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181326.612216:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408359040 00000100:00100000:1.0:1789181326.612235:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408359040 00000100:00100000:1.0:1789181326.612319:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789181326.612350:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408359040:12345-0@lo:41: 00000004:00000024:1.0:1789181326.612396:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789181326.612508:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408359040:12345-0@lo:41: Request processed in 161us (5745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181326.612516:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181326.612915:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408359040:0@lo:41: 00010000:00010000:3.0:1789181326.861994:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181327.116187:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181327.116212:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408359168:0@lo:13: 00000100:00100000:3.0:1789181327.116292:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181327.116763:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408359168 00000100:00100000:2.0:1789181327.116772:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408359168 00000100:00100000:2.0:1789181327.116826:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789181327.116851:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408359168:12345-0@lo:13: 00002000:00000024:2.0:1789181327.116880:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181327.116921:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408359296:0@lo:400: 00000100:00100000:2.0:1789181327.116930:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408359168:12345-0@lo:13: Request processed in 83us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.116936:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789181327.116952:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.117196:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408359808:0@lo:400: 00000100:00100000:1.0:1789181327.117247:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.117270:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408360320:0@lo:400: 00000100:00100000:1.0:1789181327.117292:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789181327.117325:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3883480 x1876092408359168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181327.117346:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408359168:0@lo:13: 00000100:00100000:1.0:1789181327.117365:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789181327.117371:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408359680:0@lo:400: 00000100:00100000:1.0:1789181327.117396:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.117416:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408360192:0@lo:400: 00000100:00100000:1.0:1789181327.117437:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.117451:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408360704:0@lo:400: 00000100:00100000:1.0:1789181327.117470:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.117498:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408359808 00000100:00100000:1.0:1789181327.117504:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408359808 00000100:00100000:1.0:1789181327.117532:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789181327.117540:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408359808:12345-0@lo:400: 00000100:00100000:0.0:1789181327.117568:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408359296 00000100:00100000:0.0:1789181327.117572:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408359296 00000100:00100000:1.0:1789181327.117587:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408359808:12345-0@lo:400: Request processed in 48us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.117595:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789181327.117598:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789181327.117604:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:3644:x1876092408359296:12345-0@lo:400: 00000100:00100000:1.0:1789181327.117613:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408359680 00000100:00100000:1.0:1789181327.117616:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408359680 00000100:00100000:0.0:1789181327.117638:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:3644:x1876092408359296:12345-0@lo:400: Request processed in 34us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.117641:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789181327.117646:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408359680:12345-0@lo:400: 00000100:00100000:0.0:1789181327.117649:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789181327.117673:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408359680:12345-0@lo:400: Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.117678:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789181327.117692:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408360320 00000100:00100000:1.0:1789181327.117695:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408360320 00000100:00100000:1.0:1789181327.117719:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408360192 00000100:00100000:1.0:1789181327.117738:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408360192 00000100:00100000:1.0:1789181327.117751:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408360704 00000100:00100000:1.0:1789181327.117753:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408360704 00000100:00100000:1.0:1789181327.117765:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789181327.117771:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408360320:12345-0@lo:400: 00000100:00100000:1.0:1789181327.117800:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408360320:12345-0@lo:400: Request processed in 30us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.117805:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789181327.117817:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789181327.117822:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408360192:12345-0@lo:400: 00000100:00100000:0.0:1789181327.117834:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789181327.117841:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408360704:12345-0@lo:400: 00000100:00100000:1.0:1789181327.117850:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408360192:12345-0@lo:400: Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.117856:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181327.117866:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408360704:12345-0@lo:400: Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.117871:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789181327.117872:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408359552:0@lo:400: 00000100:00100000:0.0:1789181327.117887:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181327.117894:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408360832:0@lo:13: 00000100:00100000:1.0:1789181327.117904:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.117912:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.117923:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408360064:0@lo:400: 00000100:00100000:0.0:1789181327.117934:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408359424:0@lo:400: 00000100:00100000:1.0:1789181327.117941:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789181327.117954:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181327.117958:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408360576:0@lo:400: 00000100:00080000:0.0:1789181327.117958:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181327.117966:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.117988:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408359936:0@lo:400: 00000100:00100000:0.0:1789181327.118010:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408360064 00000100:00100000:0.0:1789181327.118014:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408360064 00000100:00100000:0.0:1789181327.118051:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408359424 00000100:00100000:0.0:1789181327.118054:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408359424 00000100:00100000:0.0:1789181327.118068:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789181327.118073:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408360064:12345-0@lo:400: 00000100:00100000:0.0:1789181327.118103:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408360064:12345-0@lo:400: Request processed in 30us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.118108:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789181327.118120:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789181327.118125:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408359424:12345-0@lo:400: 00000100:00100000:0.0:1789181327.118153:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408359424:12345-0@lo:400: Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.118165:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789181327.118179:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181327.118194:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408360832 00000100:00100000:0.0:1789181327.118198:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408360832 00000100:00100000:0.0:1789181327.118217:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181327.118223:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408360832:12345-0@lo:13: 00002000:00000024:0.0:1789181327.118234:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181327.118264:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408360832:12345-0@lo:13: Request processed in 42us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.118270:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789181327.118299:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc387a680 x1876092408360832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181327.118314:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408360832:0@lo:13: 00000100:00100000:0.0:1789181327.118344:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408359680:0@lo:400: 00000100:00100000:2.0:1789181327.118676:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408359552 00000100:00100000:2.0:1789181327.118682:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408359552 00000100:00100000:2.0:1789181327.118710:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789181327.118716:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408359552:12345-0@lo:400: 00000100:00100000:2.0:1789181327.118772:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408359552:12345-0@lo:400: Request processed in 56us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.118785:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1789181327.119527:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093ed80 x1876092408360192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181327.119547:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408360192:0@lo:400: 00010000:00080000:0.0:1789181327.119573:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093dc00 x1876092408360704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181327.119581:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408360704:0@lo:400: 00000100:00100000:0.0:1789181327.119591:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408359296:0@lo:400: 00000100:00100000:0.0:1789181327.119602:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408359808:0@lo:400: 00010000:00080000:0.0:1789181327.119612:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093d880 x1876092408360320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181327.119632:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408360320:0@lo:400: 00000100:00100000:1.0:1789181327.120346:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.120415:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408359552:0@lo:400: 00010000:00080000:1.0:1789181327.120429:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093f100 x1876092408360064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181327.120438:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408360064:0@lo:400: 00000100:00100000:1.0:1789181327.120463:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.120490:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408360448:0@lo:400: 00000100:00100000:1.0:1789181327.120534:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.120579:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408359424:0@lo:400: 00000100:00100000:1.0:1789181327.120603:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408360576 00000100:00100000:1.0:1789181327.120609:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408360576 00000100:00100000:1.0:1789181327.120658:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408359936 00000100:00100000:1.0:1789181327.120662:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408359936 00000100:00100000:1.0:1789181327.120674:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408360448 00000100:00100000:1.0:1789181327.120676:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408360448 00000100:00100000:1.0:1789181327.120691:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789181327.120698:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408360576:12345-0@lo:400: 00000100:00100000:1.0:1789181327.120764:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408360576:12345-0@lo:400: Request processed in 65us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.120771:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789181327.120784:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789181327.120790:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408359936:12345-0@lo:400: 00000100:00100000:1.0:1789181327.120833:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408359936:12345-0@lo:400: Request processed in 43us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.120839:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789181327.120851:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789181327.120857:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408360448:12345-0@lo:400: 00000100:00100000:1.0:1789181327.120881:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408360448:12345-0@lo:400: Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.120887:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789181327.120901:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181327.120905:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789181327.120921:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408359936:0@lo:400: 00000100:00100000:1.0:1789181327.120930:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408360448:0@lo:400: 00010000:00080000:1.0:1789181327.120957:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093fb80 x1876092408360576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181327.120965:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408360576:0@lo:400: 00000100:00100000:2.0:1789181327.527087:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181327.530449:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385236352 00000100:00100000:0.0:1789181327.530468:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385236352 00000100:00100000:0.0:1789181327.530554:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:0.0:1789181327.530566:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+8:6170:x1876092385236352:12345-192.168.202.1@tcp:101: 00010000:00010000:0.0:1789181327.530584:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181327.530606:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658a200/0x76fb555283516fda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7de0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.530638:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658a200/0x76fb555283516fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7de0 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.530651:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658a200/0x76fb555283516fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7de0 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.530661:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658a200, rc 0) 00000100:00100000:0.0:1789181327.530794:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+9:6170:x1876092385236352:12345-192.168.202.1@tcp:101: Request processed in 229us (3717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.530802:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:0.0:1789181327.535681:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181327.536790:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385236480 00000100:00100000:1.0:1789181327.536807:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385236480 00000100:00100000:1.0:1789181327.536877:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:1.0:1789181327.536887:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+9:6170:x1876092385236480:12345-192.168.202.1@tcp:501: 00000100:00100000:1.0:1789181327.537216:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+9:6170:x1876092385236480:12345-192.168.202.1@tcp:501: Request processed in 329us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.537223:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:1.0:1789181327.541431:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181327.544259:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385236608 00000100:00100000:2.0:1789181327.544278:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385236608 00000100:00100000:2.0:1789181327.544357:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:2.0:1789181327.544368:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+9:6170:x1876092385236608:12345-192.168.202.1@tcp:503: 00000100:00100000:2.0:1789181327.544535:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+9:6170:x1876092385236608:12345-192.168.202.1@tcp:503: Request processed in 168us (3115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.544542:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:2.0:1789181327.552285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181327.554590:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385236736 00000100:00100000:1.0:1789181327.555289:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385236736 00000100:00100000:1.0:1789181327.555437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:1.0:1789181327.555448:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+9:6653:x1876092385236736:12345-192.168.202.1@tcp:502: 00000100:00100000:1.0:1789181327.555658:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+9:6653:x1876092385236736:12345-192.168.202.1@tcp:502: Request processed in 211us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.555667:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:3.0:1789181327.562369:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181327.564416:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385236864 00000100:00100000:0.0:1789181327.564433:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385236864 00000100:00100000:0.0:1789181327.564567:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:0.0:1789181327.564589:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+9:6653:x1876092385236864:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181327.564809:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+9:6653:x1876092385236864:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 231us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.564836:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:0.0:1789181327.570721:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181327.571283:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385236992 00000100:00100000:1.0:1789181327.571295:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385236992 00000100:00100000:1.0:1789181327.571360:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:1.0:1789181327.571370:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+9:6170:x1876092385236992:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181327.571388:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181327.571410:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e021f1000/0x76fb555283516fe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7de7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.571440:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e021f1000/0x76fb555283516fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7de7 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.571450:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e021f1000/0x76fb555283516fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7de7 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.571459:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e021f1000, rc 0) 00000100:00100000:1.0:1789181327.571536:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:6170:x1876092385236992:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 167us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.571543:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:1.0:1789181327.577148:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181327.577718:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385237120 00000100:00100000:0.0:1789181327.577753:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385237120 00000100:00100000:0.0:1789181327.578242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:0.0:1789181327.578258:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:6170:x1876092385237120:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181327.578414:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:6170:x1876092385237120:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 161us (1282us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789181327.578422:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 207 10000000:01000000:3.0:1789181327.819968:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789181327.819976:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1cc2475000 from 48 10000000:01000000:3.0:1789181327.819981:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789181327.820050:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.820062:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.820074:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181327.820111:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408360960:0@lo:101: 00000100:00100000:3.0:1789181327.820383:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.820452:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.820793:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408360960 00000100:00100000:2.0:1789181327.820801:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408360960 00000100:00100000:2.0:1789181327.820882:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789181327.820893:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+15:6518:x1876092408360960:12345-0@lo:101: 00010000:00010000:2.0:1789181327.820907:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181327.820920:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516fef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516fe8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.820955:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516fe8 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.820962:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516fe8 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.820969:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523a00, rc 0) 00000100:00100000:2.0:1789181327.821037:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408360960:12345-0@lo:101: Request processed in 146us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.821043:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789181327.821112:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408360960:0@lo:101: 00010000:00010000:3.0:1789181327.821148:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.821157:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181327.821219:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408361088:0@lo:501: 00000100:00100000:3.0:1789181327.821239:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.821605:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb780 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.825304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408361088 00000100:00100000:0.0:1789181327.825323:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408361088 00000100:00100000:0.0:1789181327.825392:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789181327.825403:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408361088:12345-0@lo:501: 00000100:00100000:0.0:1789181327.825649:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408361088:12345-0@lo:501: Request processed in 247us (4406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.825656:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789181327.825790:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408361088:0@lo:501: 00000100:00100000:3.0:1789181327.826111:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408361216:0@lo:503: 00000100:00100000:3.0:1789181327.833801:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.833857:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.833944:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408361216 00000100:00100000:2.0:1789181327.833953:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408361216 00000100:00100000:2.0:1789181327.833999:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789181327.834026:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408361216:12345-0@lo:503: 00000100:00100000:2.0:1789181327.834540:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408361216:12345-0@lo:503: Request processed in 523us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.834549:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789181327.834628:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408361216:0@lo:503: 00000100:00100000:0.0:1789181327.835289:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10352:1876092408361344:0@lo:502: 00000100:00100000:0.0:1789181327.835334:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.835363:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb284600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181327.835411:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408361344 00000100:00100000:1.0:1789181327.835417:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408361344 00000100:00100000:1.0:1789181327.835477:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789181327.835485:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:10352:x1876092408361344:12345-0@lo:502: 00000100:00100000:1.0:1789181327.835613:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:10352:x1876092408361344:12345-0@lo:502: Request processed in 128us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.835620:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789181327.835685:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10352:1876092408361344:0@lo:502: 00000100:00100000:2.0:1789181327.835716:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10352:1876092408361472:0@lo:502: 00000100:00100000:2.0:1789181327.835765:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181327.835821:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181327.835974:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408361472 00000100:00100000:1.0:1789181327.835978:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408361472 00000100:00100000:1.0:1789181327.836053:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789181327.836061:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:10352:x1876092408361472:12345-0@lo:502: 00000100:00100000:1.0:1789181327.836144:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+16:10352:x1876092408361472:12345-0@lo:502: Request processed in 75us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.836151:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789181327.836225:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10352:1876092408361472:0@lo:502: 00000040:00080000:3.0:1789181327.836246:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789181327.836313:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789181327.836331:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789181327.836340:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.836351:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181327.836362:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789181327.836365:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789181327.836368:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789181327.836399:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.836407:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.836416:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181327.836428:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408361600:0@lo:101: 00000100:00100000:3.0:1789181327.836456:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.838404:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.838539:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408361600 00000100:00100000:2.0:1789181327.838547:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408361600 00000100:00100000:3.0:1789181327.838652:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789181327.838661:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+16:6518:x1876092408361600:12345-0@lo:101: 00010000:00010000:3.0:1789181327.838675:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181327.838693:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085e600/0x76fb555283516ffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283516ff6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.838720:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085e600/0x76fb555283516ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283516ff6 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.838808:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085e600/0x76fb555283516ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516ff6 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.838816:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e600, rc 0) 00000100:00100000:3.0:1789181327.838882:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408361600:12345-0@lo:101: Request processed in 221us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181327.838889:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789181327.838934:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408361600:0@lo:101: 00010000:00010000:3.0:1789181327.838966:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.838975:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181327.839053:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408361728:0@lo:501: 00000100:00100000:3.0:1789181327.839083:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.839108:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789181327.839118:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408361728 00000100:00100000:3.0:1789181327.839122:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408361728 00000100:00100000:3.0:1789181327.840008:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789181327.840030:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408361728:12345-0@lo:501: 00000100:00100000:3.0:1789181327.840486:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408361728:12345-0@lo:501: Request processed in 444us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181327.840505:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789181327.842076:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408361728:0@lo:501: 00000100:00100000:1.0:1789181327.843040:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408361856:0@lo:503: 00000100:00100000:0.0:1789181327.843351:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.843435:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb3400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181327.843514:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408361856 00000100:00100000:1.0:1789181327.843522:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408361856 00000100:00100000:1.0:1789181327.843607:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789181327.843619:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408361856:12345-0@lo:503: 00000100:00100000:1.0:1789181327.843775:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408361856:12345-0@lo:503: Request processed in 159us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.843782:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789181327.843877:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408361856:0@lo:503: 00000100:00100000:0.0:1789181327.846216:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10353:1876092408361984:0@lo:502: 00000100:00100000:0.0:1789181327.846298:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.846342:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb284b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181327.846434:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408361984 00000100:00100000:1.0:1789181327.846443:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408361984 00000100:00100000:1.0:1789181327.846495:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789181327.846505:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:10353:x1876092408361984:12345-0@lo:502: 00000100:00100000:1.0:1789181327.846630:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+17:10353:x1876092408361984:12345-0@lo:502: Request processed in 127us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.846646:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789181327.846872:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10353:1876092408361984:0@lo:502: 00000020:01000000:0.0:1789181327.846903:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181327.846913:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181327.846916:0:10353:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789181327.846922:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789181327.846946:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10353:1876092408362112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181327.846980:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.846997:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb284b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181327.847082:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408362112 00000100:00100000:1.0:1789181327.847087:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408362112 00000100:00100000:1.0:1789181327.847118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789181327.847126:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:10353:x1876092408362112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181327.847205:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+17:10353:x1876092408362112:12345-0@lo:502:llog_process_th.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.847211:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789181327.847285:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10353:1876092408362112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181327.847305:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181327.847310:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181327.847316:0:10353:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789181327.847320:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1789181327.847534:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789181327.847552:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789181327.847559:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.847568:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181327.847575:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789181327.847576:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1dfb02c800 from 48 10000000:01000000:1.0:1789181327.847578:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789181327.847603:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.847612:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.847621:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181327.847635:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408362240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.847666:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.847690:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc5fc4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.847759:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408362240 00000100:00100000:2.0:1789181327.847763:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408362240 00000100:00100000:2.0:1789181327.847786:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789181327.847791:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+17:6518:x1876092408362240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181327.847798:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181327.847807:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523200/0x76fb55528351700b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283517004 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.847825:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523200/0x76fb55528351700b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283517004 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.847832:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523200/0x76fb55528351700b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517004 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.847838:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523200, rc 0) 00000100:00100000:2.0:1789181327.847861:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408362240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.847866:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789181327.847981:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408362240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181327.847994:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.848002:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181327.848059:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408362368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.848084:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.848111:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc5fc4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.848220:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408362368 00000100:00100000:0.0:1789181327.848225:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408362368 00000100:00100000:0.0:1789181327.848249:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789181327.848253:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408362368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181327.848333:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408362368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.848337:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789181327.848403:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408362368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.848423:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408362496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.848449:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.848466:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc5fc4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.848499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408362496 00000100:00100000:0.0:1789181327.848502:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408362496 00000100:00100000:0.0:1789181327.848523:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789181327.848527:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408362496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181327.848598:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408362496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.848604:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789181327.848670:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408362496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181327.849157:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10354:1876092408362624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181327.849195:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181327.849227:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.849307:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408362624 00000100:00100000:0.0:1789181327.849313:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408362624 00000100:00100000:0.0:1789181327.849344:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789181327.849349:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:10354:x1876092408362624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181327.849424:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+18:10354:x1876092408362624:12345-0@lo:502:llog_process_th.0 Request processed in 74us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.849433:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789181327.849666:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10354:1876092408362624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181327.849703:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10354:1876092408362752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181327.849760:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181327.849776:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181327.849815:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408362752 00000100:00100000:1.0:1789181327.849818:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408362752 00000100:00100000:1.0:1789181327.849841:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789181327.849845:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:10354:x1876092408362752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181327.849924:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:10354:x1876092408362752:12345-0@lo:502:llog_process_th.0 Request processed in 78us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.849930:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789181327.850099:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10354:1876092408362752:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789181327.850117:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789181327.850316:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789181327.850335:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789181327.850343:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.850360:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181327.850368:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789181327.850370:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789181327.850373:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789181327.850396:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.850401:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.850408:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181327.850418:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408362880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.850439:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.850463:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.850497:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408362880 00000100:00100000:2.0:1789181327.850501:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408362880 00000100:00100000:2.0:1789181327.850524:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789181327.850528:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+18:6518:x1876092408362880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181327.850535:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181327.850544:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522e00/0x76fb555283517019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283517012 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.850560:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522e00/0x76fb555283517019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283517012 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.850566:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522e00/0x76fb555283517019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517012 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.850572:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522e00, rc 0) 00000100:00100000:2.0:1789181327.850597:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408362880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.850602:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789181327.850664:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408362880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181327.850672:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.850679:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181327.850751:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408363008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.850769:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.850786:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.850825:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408363008 00000100:00100000:2.0:1789181327.850828:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408363008 00000100:00100000:2.0:1789181327.850848:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789181327.850852:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408363008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181327.850938:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408363008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.850945:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789181327.851010:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408363008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.851044:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408363136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.851076:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.851101:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.851164:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408363136 00000100:00100000:0.0:1789181327.851168:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408363136 00000100:00100000:0.0:1789181327.851198:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789181327.851206:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408363136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181327.851272:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408363136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.851276:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789181327.851384:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408363136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.852046:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10355:1876092408363264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181327.852089:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.852121:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.852226:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408363264 00000100:00100000:0.0:1789181327.852232:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408363264 00000100:00100000:0.0:1789181327.852265:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789181327.852272:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+19:10355:x1876092408363264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181327.852365:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+19:10355:x1876092408363264:12345-0@lo:502:llog_process_th.0 Request processed in 93us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.852372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789181327.852449:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10355:1876092408363264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181327.852472:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181327.852481:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181327.852483:0:10355:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789181327.852488:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789181327.852508:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10355:1876092408363392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181327.852541:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181327.852565:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.852895:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408363392 00000100:00100000:0.0:1789181327.852900:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408363392 00000100:00100000:0.0:1789181327.852927:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789181327.852934:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+19:10355:x1876092408363392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181327.853002:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+19:10355:x1876092408363392:12345-0@lo:502:llog_process_th.0 Request processed in 68us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.853009:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789181327.853106:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10355:1876092408363392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181327.853124:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181327.853128:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181327.853130:0:10355:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789181327.853144:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1789181327.853392:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789181327.853420:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789181327.853432:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.853451:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181327.853461:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789181327.853464:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1df1a64800 from 48 10000000:01000000:0.0:1789181327.853467:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181327.853493:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.853501:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.853510:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181327.853523:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408363520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181327.853553:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.853585:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181327.853646:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408363520 00000100:00100000:1.0:1789181327.853651:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408363520 00000100:00100000:1.0:1789181327.853685:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789181327.853692:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+19:6518:x1876092408363520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181327.853701:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181327.853713:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e021f0600/0x76fb555283517027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283517020 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.853763:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e021f0600/0x76fb555283517027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283517020 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.853773:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e021f0600/0x76fb555283517027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517020 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.853781:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e021f0600, rc 0) 00000100:00100000:1.0:1789181327.853813:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408363520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.853819:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789181327.854059:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408363520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181327.854073:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.854082:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181327.854130:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408363648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181327.854166:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.854190:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181327.855239:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408363648 00000100:00100000:1.0:1789181327.855249:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408363648 00000100:00100000:1.0:1789181327.855302:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789181327.855312:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408363648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.855468:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408363648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.855474:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789181327.856031:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408363648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.856087:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408363776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.856155:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.856182:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10ebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.856296:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408363776 00000100:00100000:0.0:1789181327.856302:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408363776 00000100:00100000:0.0:1789181327.856349:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789181327.856357:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408363776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181327.856458:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408363776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.856465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789181327.856840:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408363776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.859052:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10356:1876092408363904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181327.859210:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.859300:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb240 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.859446:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408363904 00000100:00100000:0.0:1789181327.859455:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408363904 00000100:00100000:0.0:1789181327.859537:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789181327.859548:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:10356:x1876092408363904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181327.859672:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:10356:x1876092408363904:12345-0@lo:502:llog_process_th.0 Request processed in 126us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.859681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789181327.859790:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10356:1876092408363904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181327.859854:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10356:1876092408364032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181327.859885:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.860142:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.860277:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408364032 00000100:00100000:2.0:1789181327.860283:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408364032 00000100:00100000:2.0:1789181327.860308:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789181327.860315:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:10356:x1876092408364032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181327.860439:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:10356:x1876092408364032:12345-0@lo:502:llog_process_th.0 Request processed in 123us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.860446:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789181327.860549:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10356:1876092408364032:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789181327.860571:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789181327.863346:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789181327.863393:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789181327.863405:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.863418:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181327.863428:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789181327.863431:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789181327.863433:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789181327.863472:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.863497:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.863509:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181327.863535:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408364160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181327.863601:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.863682:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210240 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.864154:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408364160 00000100:00100000:2.0:1789181327.864163:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408364160 00000100:00100000:2.0:1789181327.864202:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789181327.864211:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408364160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181327.864224:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181327.864237:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523c00/0x76fb555283517035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351702e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.864274:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523c00/0x76fb555283517035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351702e expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.864285:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523c00/0x76fb555283517035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351702e expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.864295:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523c00, rc 0) 00000100:00100000:2.0:1789181327.864392:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408364160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.864399:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789181327.864674:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408364160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181327.864690:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.864700:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181327.865105:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408364288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.865263:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.865305:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb240 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.865365:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408364288 00000100:00100000:0.0:1789181327.865371:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408364288 00000100:00100000:0.0:1789181327.865414:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789181327.865422:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408364288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181327.865538:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408364288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.865545:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789181327.866267:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408364288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.866314:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408364416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.866374:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.866398:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181327.866414:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408364416 00000100:00100000:3.0:1789181327.866419:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408364416 00000100:00100000:3.0:1789181327.866449:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789181327.866456:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408364416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.866540:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408364416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181327.866553:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789181327.866597:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408364416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.867690:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10357:1876092408364544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181327.867799:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.867879:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.868243:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408364544 00000100:00100000:0.0:1789181327.868250:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408364544 00000100:00100000:0.0:1789181327.868315:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789181327.868324:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:10357:x1876092408364544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181327.868437:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:10357:x1876092408364544:12345-0@lo:502:llog_process_th.0 Request processed in 114us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.868445:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789181327.868508:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10357:1876092408364544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181327.868531:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181327.868540:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181327.868542:0:10357:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789181327.868547:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789181327.868565:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10357:1876092408364672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181327.868594:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.868676:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.868775:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408364672 00000100:00100000:2.0:1789181327.868780:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408364672 00000100:00100000:2.0:1789181327.868799:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789181327.868805:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:10357:x1876092408364672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181327.868982:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10357:1876092408364672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181327.868999:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181327.869003:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181327.869005:0:10357:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789181327.869008:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000100:00100000:2.0:1789181327.869225:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:10357:x1876092408364672:12345-0@lo:502:llog_process_th.0 Request processed in 419us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.869232:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000020:01000000:0.0:1789181327.869392:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789181327.869415:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789181327.869426:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.869445:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181327.869456:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789181327.869458:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1dc32aa000 from 48 10000000:01000000:0.0:1789181327.869461:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181327.869487:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.869495:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.869503:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181327.869517:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408364800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181327.869546:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.869574:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc72100c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.869625:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408364800 00000100:00100000:2.0:1789181327.869631:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408364800 00000100:00100000:2.0:1789181327.869660:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789181327.869667:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408364800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181327.869675:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181327.869687:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522200/0x76fb555283517043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351703c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.869706:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522200/0x76fb555283517043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351703c expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.869751:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522200/0x76fb555283517043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351703c expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.869760:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522200, rc 0) 00000100:00100000:2.0:1789181327.869797:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408364800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.869802:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789181327.869960:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408364800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181327.869972:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181327.869980:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181327.870039:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408364928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.870072:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.870098:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.870202:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408364928 00000100:00100000:2.0:1789181327.870207:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408364928 00000100:00100000:2.0:1789181327.870224:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789181327.870230:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408364928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181327.870549:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408364928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.870556:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789181327.870951:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408364928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.870987:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408365056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.871040:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.871099:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.871129:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408365056 00000100:00100000:2.0:1789181327.871196:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408365056 00000100:00100000:2.0:1789181327.871265:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789181327.871274:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408365056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181327.871365:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408365056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.871372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789181327.871431:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408365056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181327.871757:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10358:1876092408365184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181327.871792:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.872265:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10ebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.872317:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408365184 00000100:00100000:0.0:1789181327.872323:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408365184 00000100:00100000:0.0:1789181327.872351:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789181327.872359:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:10358:x1876092408365184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181327.872469:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:10358:x1876092408365184:12345-0@lo:502:llog_process_th.0 Request processed in 110us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.872476:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789181327.872560:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10358:1876092408365184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181327.872603:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10358:1876092408365312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181327.872636:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181327.872655:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10ebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.872700:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408365312 00000100:00100000:0.0:1789181327.872704:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408365312 00000100:00100000:0.0:1789181327.872747:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789181327.872764:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:10358:x1876092408365312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181327.872826:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:10358:x1876092408365312:12345-0@lo:502:llog_process_th.0 Request processed in 63us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.872832:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789181327.873334:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10358:1876092408365312:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789181327.873355:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789181327.873539:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789181327.873562:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789181327.873572:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.873582:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181327.873592:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789181327.873594:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1789181327.873597:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789181327.873621:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.873628:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.873636:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181327.873651:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408365440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.873688:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.873852:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181327.873953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408365440 00000100:00100000:0.0:1789181327.873959:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408365440 00000100:00100000:0.0:1789181327.874040:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789181327.874048:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408365440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181327.874057:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181327.874069:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658b400/0x76fb555283517051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351704a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.874090:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658b400/0x76fb555283517051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351704a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.874101:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658b400/0x76fb555283517051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351704a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181327.874110:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b400, rc 0) 00000100:00100000:0.0:1789181327.874157:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408365440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181327.874163:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789181327.874226:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408365440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181327.874239:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.874248:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181327.874301:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408365568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.874327:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.874471:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.874530:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408365568 00000100:00100000:2.0:1789181327.874535:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408365568 00000100:00100000:2.0:1789181327.874557:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789181327.874564:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408365568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181327.874717:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408365568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.874750:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789181327.877084:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408365568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.877213:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408365696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.877287:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.877326:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.877378:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408365696 00000100:00100000:2.0:1789181327.877385:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408365696 00000100:00100000:2.0:1789181327.877432:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789181327.877441:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408365696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181327.877566:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408365696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.877574:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789181327.877703:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408365696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.879252:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10359:1876092408365824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181327.879321:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.879362:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4ce66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.879652:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408365824 00000100:00100000:2.0:1789181327.879660:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408365824 00000100:00100000:2.0:1789181327.879696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789181327.879704:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:10359:x1876092408365824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181327.880256:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:10359:x1876092408365824:12345-0@lo:502:llog_process_th.0 Request processed in 550us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.880265:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789181327.880614:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10359:1876092408365824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181327.880650:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181327.880660:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181327.880662:0:10359:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789181327.880668:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789181327.880698:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10359:1876092408365952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181327.880839:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.881052:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181327.881091:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408365952 00000100:00100000:3.0:1789181327.881097:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408365952 00000100:00100000:3.0:1789181327.881234:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789181327.881243:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:10359:x1876092408365952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181327.881353:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:10359:x1876092408365952:12345-0@lo:502:llog_process_th.0 Request processed in 110us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181327.881360:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789181327.881433:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10359:1876092408365952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181327.881453:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181327.881459:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181327.881460:0:10359:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789181327.881464:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789181327.881639:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1789181327.881665:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789181327.881675:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.881687:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181327.881709:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789181327.881712:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c1dd13ecd40 from 1 10000000:01000000:1.0:1789181327.881715:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789181327.881770:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1800/0x76fb555283517058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.881779:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1800/0x76fb555283517058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.881788:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1800/0x76fb555283517058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181327.881804:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408366080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.881835:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181327.882458:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.882511:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408366080 00000100:00100000:2.0:1789181327.882518:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408366080 00000100:00100000:2.0:1789181327.882550:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789181327.882558:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408366080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181327.882569:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181327.882582:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523800/0x76fb55528351705f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283517058 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.882605:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523800/0x76fb55528351705f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283517058 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.882618:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523800/0x76fb55528351705f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517058 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.882636:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523800, rc 0) 00000100:00100000:2.0:1789181327.882688:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408366080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181327.882695:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789181327.882787:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408366080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181327.882801:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1800/0x76fb555283517058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351705f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.882810:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1800/0x76fb555283517058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351705f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181327.882884:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408366208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181327.882912:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.882937:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181327.883039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408366208 00000100:00100000:2.0:1789181327.883043:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408366208 00000100:00100000:2.0:1789181327.883063:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789181327.883068:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408366208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181327.883144:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408366208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (222us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789181327.883150:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789181327.884505:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408366208:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789181327.884541:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789181327.884565:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1800/0x76fb555283517058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351705f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181327.884576:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1800/0x76fb555283517058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351705f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181327.884932:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181328.907964:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789181328.997842:0:10396:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff270cce60 20000000:00000080:3.0:1789181328.997863:0:10396:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c1dff826400 uarg=0000000000000000 20000000:01000000:3.0:1789181328.997908:0:10396:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789181328.997923:0:10396:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789181328.997928:0:10396:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789181329.001388:0:10397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789181329.001782:0:10396:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789181329.011221:0:10396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789181329.011256:0:10396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789181329.011269:0:10396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789181329.011289:0:10396:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789181329.011310:0:10396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.011331:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1679c00/0x76fb555283516d02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516cfb expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.011338:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658b600/0x76fb555283516d10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516d09 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.011345:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516d5d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.011352:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516e8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283516e83 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.011361:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e021f0400/0x76fb555283516fa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da8 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.011369:0:10396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.011419:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e021f0400/0x76fb555283516fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da8 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.011715:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e021f0400/0x76fb555283516fa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da8 expref: 9 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181329.011756:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876092408366336:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181329.011889:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516e83 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.011898:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516e8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516e83 expref: 23 pid: 6516 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181329.011906:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3881880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876092408366464:0@lo:104: 00000100:00100000:3.0:1789181329.011961:0:10396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181329.012009:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516d5d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.012018:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516d5d expref: 23 pid: 6516 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181329.012026:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876092408366592:0@lo:104: 00000100:00100000:3.0:1789181329.012049:0:10396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181329.012079:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658b600/0x76fb555283516d10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516d09 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.012087:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc658b600/0x76fb555283516d10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516d09 expref: 23 pid: 6513 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181329.012095:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3881c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876092408366720:0@lo:104: 00010000:00010000:3.0:1789181329.012129:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1679c00/0x76fb555283516d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283516cfb expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.012145:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c1dc1679c00/0x76fb555283516d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283516cfb expref: 23 pid: 6513 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181329.012165:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876092408366848:0@lo:104: 00000100:00100000:3.0:1789181329.012184:0:10396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb000 going to sleep for 11 seconds 00000100:00100000:1.0:1789181329.013775:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789181329.013819:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181329.013853:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181329.013863:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408366464 00000100:00100000:1.0:1789181329.013871:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408366464 00000100:00100000:3.0:1789181329.013900:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408366592 00000100:00100000:3.0:1789181329.013905:0:9526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408366592 00000100:00100000:1.0:1789181329.013914:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408366720 00000100:00100000:1.0:1789181329.013917:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408366720 00000100:00100000:1.0:1789181329.013928:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408366848 00000100:00100000:1.0:1789181329.013930:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408366848 00000100:00100000:1.0:1789181329.013942:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789181329.013950:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+6:10396:x1876092408366464:12345-0@lo:104: 00010000:00010000:1.0:1789181329.013967:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014077:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789181329.014084:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+6:10396:x1876092408366464:12345-0@lo:104: Request processed in 134us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181329.014090:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789181329.014111:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789181329.014117:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+5:10396:x1876092408366720:12345-0@lo:104: 00010000:00010000:1.0:1789181329.014126:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014160:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789181329.014179:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+5:10396:x1876092408366720:12345-0@lo:104: Request processed in 62us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181329.014185:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789181329.014198:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181329.014204:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:10396:x1876092408366848:12345-0@lo:104: 00010000:00010000:1.0:1789181329.014211:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb555283516cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014239:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789181329.014243:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:10396:x1876092408366848:12345-0@lo:104: Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181329.014249:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1789181329.014267:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789181329.014273:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014281:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e00866a00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:1.0:1789181329.014286:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014294:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181329.014301:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181329.014307:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789181329.014347:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014362:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789181329.014381:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789181329.014382:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181329.014388:0:9526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff826c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:da575344-f445-48a7-8532-0e6efd2ea878+3:10396:x1876092408366592:12345-0@lo:104: 00010000:00010000:1.0:1789181329.014390:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e00866a00/0x76fb555283516e83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516e8a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.014397:0:9526:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014402:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181329.014406:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014411:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658ac00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:1.0:1789181329.014414:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014420:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181329.014427:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181329.014432:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789181329.014445:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014450:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181329.014456:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014462:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283516d09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014476:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181329.014479:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb555283516cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014486:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679000 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:1.0:1789181329.014489:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb555283516cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014496:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb555283516cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181329.014504:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb555283516cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181329.014509:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789181329.014523:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb555283516cfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014528:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181329.014540:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb555283516cfb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014545:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb555283516cfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181329.014556:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181329.014557:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181329.014564:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181329.014593:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408366976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181329.014631:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181329.014666:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181329.014672:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408367104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181329.014707:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181329.014779:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408366976 00000100:00100000:1.0:1789181329.014784:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408366976 00010000:00010000:1.0:1789181329.014807:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516e8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516e83 expref: 24 pid: 6516 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181329.014824:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408367104 00000100:00100000:1.0:1789181329.014827:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408367104 00010000:00010000:1.0:1789181329.014837:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658b600/0x76fb555283516d10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516d09 expref: 25 pid: 6513 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181329.014853:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181329.014859:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+25:3645:x1876092408366976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181329.014871:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181329.014876:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516e8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516e83 expref: 25 pid: 6516 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014886:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516e8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516e83 expref: 25 pid: 6516 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014904:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181329.014932:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+25:3645:x1876092408366976:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181329.014937:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181329.014950:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181329.014956:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408367104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181329.014970:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181329.014974:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9c1dc658b600/0x76fb555283516d10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516d09 expref: 24 pid: 6513 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014983:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658b600/0x76fb555283516d10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516d09 expref: 24 pid: 6513 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181329.014993:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181329.015027:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408367104:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181329.015033:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1789181329.015067:0:9526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181329.015073:0:9526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff826c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:da575344-f445-48a7-8532-0e6efd2ea878+3:10396:x1876092408366592:12345-0@lo:104: Request processed in 686us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181329.015073:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408367104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181329.015080:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181329.015082:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408366976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181329.015139:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181329.015144:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.015160:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181329.015163:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.015169:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181329.015175:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181329.015186:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789181329.015212:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.015218:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181329.015226:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.015232:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1678200/0x76fb555283516d5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283516d64 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.015246:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181329.015248:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181329.015248:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408367232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181329.015249:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181329.015277:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181329.015308:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181329.015313:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408367360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181329.015335:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181329.015968:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1522a00/0x76fb555283516e8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516e83 expref: 23 pid: 6516 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181329.015981:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3881880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876092408366464:0@lo:104: 00000100:00100000:1.0:1789181329.015991:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876092408366592:0@lo:104: 00010000:00010000:1.0:1789181329.016012:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658b600/0x76fb555283516d10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516d09 expref: 22 pid: 6513 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181329.016020:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3881c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876092408366720:0@lo:104: 00000100:00100000:1.0:1789181329.016029:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876092408366848:0@lo:104: 00000100:00100000:0.0:1789181329.022650:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408367232 00000100:00100000:0.0:1789181329.022670:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408367232 00010000:00010000:0.0:1789181329.022751:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1679c00/0x76fb555283516d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516cfb expref: 22 pid: 6513 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181329.022804:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408367360 00000100:00100000:0.0:1789181329.022809:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408367360 00010000:00010000:0.0:1789181329.022823:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516d5d expref: 23 pid: 6516 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181329.022840:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181329.022849:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+23:3643:x1876092408367232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181329.022865:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181329.022871:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9c1dc1679c00/0x76fb555283516d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516cfb expref: 23 pid: 6513 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.022902:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1679c00/0x76fb555283516d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516cfb expref: 23 pid: 6513 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.022923:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1679c00/0x76fb555283516d02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516cfb expref: 23 pid: 6513 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.022942:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181329.023046:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+22:3643:x1876092408367232:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (7767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181329.023052:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181329.023070:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789181329.023077:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+21:3643:x1876092408367360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181329.023086:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181329.023090:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283516d5d expref: 21 pid: 6516 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.023098:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283516d5d expref: 21 pid: 6516 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.023107:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f0200/0x76fb555283516d64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283516d5d expref: 21 pid: 6516 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.023115:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181329.023138:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+20:3643:x1876092408367360:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (7802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181329.023143:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789181329.023216:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408367360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181329.023225:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408367232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181329.025920:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181329.026041:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385237248 00000100:00100000:0.0:1789181329.026051:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385237248 00010000:00010000:0.0:1789181329.026093:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e021f0400/0x76fb555283516fa2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da8 expref: 10 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181329.026122:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1789181329.026132:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385237248:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181329.026146:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181329.026151:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9c1e021f0400/0x76fb555283516fa2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da8 expref: 10 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026164:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e021f0400/0x76fb555283516fa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da8 expref: 10 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026185:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026194:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026211:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026218:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026225:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026232:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026253:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fa00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181329.026258:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026267:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026275:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181329.026284:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181329.026335:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385237248:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 205us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181329.026342:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00010000:00010000:3.0:1789181329.026582:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f0400/0x76fb555283516fa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da8 expref: 9 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181329.026595:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876092408366336:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181329.026694:0:10396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.026703:0:10396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.026709:0:10396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181329.026714:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517066 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181329.164860:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408367488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181329.164962:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181329.165413:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408367488 00000100:00100000:2.0:1789181329.165820:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408367488 00000100:00100000:2.0:1789181329.165881:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789181329.165892:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408367488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789181329.165931:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789181329.166020:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408367488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181329.166303:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789181329.166372:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408367488:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789181329.932666:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181330.084686:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181330.084846:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385237376 00000100:00100000:0.0:1789181330.084856:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385237376 00000100:00100000:0.0:1789181330.084918:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00100000:0.0:1789181330.084927:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+9:6170:x1876092385237376:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181330.084945:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181330.084966:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658be00/0x76fb55528351706d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7dee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.085012:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658be00/0x76fb55528351706d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dee expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.085031:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658be00/0x76fb55528351706d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dee expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.085056:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658be00, rc 0) 00000100:00100000:0.0:1789181330.085124:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+10:6170:x1876092385237376:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 198us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.085128:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00100000:0.0:1789181330.100445:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181330.100948:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385237504 00000100:00100000:1.0:1789181330.100959:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385237504 00000100:00100000:1.0:1789181330.101042:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:1.0:1789181330.101053:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:6170:x1876092385237504:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181330.101628:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:6170:x1876092385237504:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 574us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181330.101639:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:0.0:1789181330.104186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181330.104535:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385237632 00000100:00100000:3.0:1789181330.104548:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385237632 00000100:00100000:3.0:1789181330.104613:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:3.0:1789181330.104623:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:6170:x1876092385237632:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181330.104829:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:6170:x1876092385237632:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 200us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.104838:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:3.0:1789181330.119308:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181330.119899:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385237760 00000100:00100000:0.0:1789181330.119979:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385237760 00000100:00100000:0.0:1789181330.120062:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:0.0:1789181330.120075:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:6711:x1876092385237760:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181330.121391:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:6711:x1876092385237760:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 1312us (2088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.121403:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:0.0:1789181330.132850:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181330.135497:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385237888 00000100:00100000:3.0:1789181330.135516:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385237888 00000100:00100000:3.0:1789181330.135576:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:3.0:1789181330.135586:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+10:6711:x1876092385237888:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789181330.135748:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+10:6711:x1876092385237888:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 138us (2885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.135765:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 254 10000000:01000000:1.0:1789181330.635782:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789181330.635789:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1cc2475000 from 4 10000000:01000000:1.0:1789181330.635793:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789181330.635842:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.635855:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.635867:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181330.635892:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408367616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181330.635976:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181330.636043:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f8a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.638958:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408367616 00000100:00100000:3.0:1789181330.638973:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408367616 00000100:00100000:3.0:1789181330.639040:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789181330.639051:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408367616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181330.639067:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181330.639085:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351707b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283517074 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.639120:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351707b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283517074 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.639141:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351707b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517074 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.639151:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085ee00, rc 0) 00000100:00100000:3.0:1789181330.639224:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408367616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (3248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.639230:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789181330.639287:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408367616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181330.639305:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.639314:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181330.639386:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408367744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181330.639414:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.639449:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181330.641913:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408367744 00000100:00100000:0.0:1789181330.641927:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408367744 00000100:00100000:0.0:1789181330.642012:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789181330.642022:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408367744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181330.642331:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408367744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (2915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.642338:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789181330.643213:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408367744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.643293:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408367872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.643350:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.643388:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.643406:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408367872 00000100:00100000:2.0:1789181330.643410:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408367872 00000100:00100000:2.0:1789181330.643446:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789181330.643453:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408367872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.643562:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408367872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.643569:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789181330.644563:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408367872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.646902:0:10465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10465:1876092408368000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181330.647894:0:10465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.648123:0:10465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.653905:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408368000 00000100:00100000:3.0:1789181330.653921:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408368000 00000100:00100000:3.0:1789181330.654002:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789181330.654013:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:10465:x1876092408368000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181330.654666:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:10465:x1876092408368000:12345-0@lo:502:llog_process_th.0 Request processed in 653us (6777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.654676:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789181330.654971:0:10465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10465:1876092408368000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181330.655021:0:10465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181330.655032:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181330.655035:0:10465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789181330.655042:0:10465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1cc2475000 00000020:00000080:2.0:1789181330.655044:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789181330.657225:0:10465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10465:1876092408368128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181330.657322:0:10465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.657383:0:10465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.657839:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408368128 00000100:00100000:3.0:1789181330.657849:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408368128 00000100:00100000:3.0:1789181330.657907:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789181330.657919:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:10465:x1876092408368128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181330.658077:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:10465:x1876092408368128:12345-0@lo:502:llog_process_th.0 Request processed in 160us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.658085:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789181330.658890:0:10465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10465:1876092408368128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181330.658931:0:10465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181330.658945:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181330.658947:0:10465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789181330.658952:0:10465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789181330.659032:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789181330.659054:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181330.659064:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.659075:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181330.659086:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181330.659090:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dfb02c800 from 4 10000000:01000000:2.0:1789181330.659093:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181330.659134:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.659143:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.659153:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.659173:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408368256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.659221:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.659249:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.659809:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408368256 00000100:00100000:3.0:1789181330.659818:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408368256 00000100:00100000:3.0:1789181330.659870:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789181330.659879:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408368256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181330.659892:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181330.659908:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517089 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283517082 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.659936:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283517082 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.659947:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517082 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.659956:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fa00, rc 0) 00000100:00100000:3.0:1789181330.660018:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408368256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.660024:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789181330.660070:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408368256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181330.660085:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.660095:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181330.660185:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408368384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181330.660214:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.660238:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de1836000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.660251:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408368384 00000100:00100000:3.0:1789181330.660256:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408368384 00000100:00100000:3.0:1789181330.660279:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789181330.660286:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408368384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181330.660398:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408368384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.660406:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789181330.660435:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408368384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181330.660464:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408368512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181330.660502:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.660515:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de1836000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.660528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408368512 00000100:00100000:3.0:1789181330.660531:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408368512 00000100:00100000:3.0:1789181330.660553:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789181330.660559:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408368512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181330.660639:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408368512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.660645:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789181330.660683:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408368512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181330.660900:0:10466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10466:1876092408368640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181330.660941:0:10466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.660961:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408368640 00000100:00100000:3.0:1789181330.660964:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408368640 00000100:00100000:3.0:1789181330.660998:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789181330.661005:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+22:10466:x1876092408368640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181330.661074:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+22:10466:x1876092408368640:12345-0@lo:502:llog_process_th.0 Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.661082:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789181330.661108:0:10466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.661120:0:10466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10466:1876092408368640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181330.661141:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181330.661149:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181330.661152:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789181330.661164:0:10466:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1dfb02c800 00000020:00000080:3.0:1789181330.661166:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789181330.665138:0:10466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10466:1876092408368768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181330.665231:0:10466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.665271:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408368768 00000100:00100000:3.0:1789181330.665278:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408368768 00000100:00100000:3.0:1789181330.665325:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789181330.665334:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+22:10466:x1876092408368768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181330.665461:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+22:10466:x1876092408368768:12345-0@lo:502:llog_process_th.0 Request processed in 128us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.665469:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789181330.665523:0:10466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.665543:0:10466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10466:1876092408368768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181330.665578:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181330.665585:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181330.665588:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789181330.665595:0:10466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789181330.665663:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789181330.665680:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181330.665690:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.665702:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181330.665712:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789181330.665715:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1df1a64800 from 4 10000000:01000000:3.0:1789181330.665718:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181330.665758:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.665766:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.665775:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181330.665788:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408368896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789181330.665815:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.665828:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.666862:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408368896 00000100:00100000:2.0:1789181330.666870:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408368896 00000100:00100000:2.0:1789181330.666920:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789181330.666930:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408368896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181330.666944:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181330.666968:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523400/0x76fb555283517097 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283517090 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.667007:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523400/0x76fb555283517097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283517090 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.667021:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523400/0x76fb555283517097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517090 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.667030:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523400, rc 0) 00000100:00100000:2.0:1789181330.667091:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408368896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.667097:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789181330.667162:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408368896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181330.667181:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.667191:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.667254:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408369024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.667284:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.667302:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.667315:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408369024 00000100:00100000:2.0:1789181330.667318:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408369024 00000100:00100000:2.0:1789181330.667343:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789181330.667350:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408369024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.667470:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408369024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.667483:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789181330.667515:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408369024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.667541:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408369152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.667578:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.667591:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.667603:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408369152 00000100:00100000:2.0:1789181330.667606:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408369152 00000100:00100000:2.0:1789181330.667623:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789181330.667628:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408369152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.667697:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408369152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.667704:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789181330.667763:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408369152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.667951:0:10468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10468:1876092408369280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181330.667984:0:10468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.668017:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408369280 00000100:00100000:2.0:1789181330.668021:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408369280 00000100:00100000:2.0:1789181330.668045:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789181330.668050:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:10468:x1876092408369280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181330.668121:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:10468:x1876092408369280:12345-0@lo:502:llog_process_th.0 Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.668127:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789181330.668153:0:10468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.668165:0:10468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10468:1876092408369280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181330.668190:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181330.668199:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181330.668201:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789181330.668207:0:10468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1df1a64800 00000020:00000080:2.0:1789181330.668210:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789181330.668618:0:10468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10468:1876092408369408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181330.668655:0:10468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.668675:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408369408 00000100:00100000:2.0:1789181330.668679:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408369408 00000100:00100000:2.0:1789181330.668702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789181330.668709:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:10468:x1876092408369408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181330.668794:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:10468:x1876092408369408:12345-0@lo:502:llog_process_th.0 Request processed in 85us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.668800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789181330.668829:0:10468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.668841:0:10468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10468:1876092408369408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181330.668858:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181330.668863:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181330.668865:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789181330.668868:0:10468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789181330.668922:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789181330.668942:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181330.668949:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.668959:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181330.668978:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181330.668981:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dc32aa000 from 4 10000000:01000000:2.0:1789181330.668983:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181330.669015:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.669023:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.669032:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.669044:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408369536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.669072:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.669086:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.669097:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408369536 00000100:00100000:2.0:1789181330.669100:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408369536 00000100:00100000:2.0:1789181330.669120:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789181330.669125:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408369536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181330.669133:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181330.669142:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522800/0x76fb5552835170a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351709e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.669161:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522800/0x76fb5552835170a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351709e expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.669171:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522800/0x76fb5552835170a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351709e expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.669190:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522800, rc 0) 00000100:00100000:2.0:1789181330.669218:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408369536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.669224:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789181330.669251:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408369536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181330.669262:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.669271:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.669315:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408369664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.669337:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.669350:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.669360:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408369664 00000100:00100000:2.0:1789181330.669363:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408369664 00000100:00100000:2.0:1789181330.669381:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789181330.669386:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408369664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.669462:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408369664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.669467:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789181330.669496:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408369664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.669519:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408369792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.669550:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.669569:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.669580:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408369792 00000100:00100000:2.0:1789181330.669583:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408369792 00000100:00100000:2.0:1789181330.669603:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789181330.669609:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408369792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181330.669672:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408369792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.669678:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789181330.669714:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408369792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181330.670717:0:10469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10469:1876092408369920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181330.670960:0:10469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181330.671017:0:10469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.671062:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408369920 00000100:00100000:3.0:1789181330.671070:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408369920 00000100:00100000:3.0:1789181330.671122:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789181330.671132:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:10469:x1876092408369920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181330.671234:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:10469:x1876092408369920:12345-0@lo:502:llog_process_th.0 Request processed in 104us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.671241:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789181330.671448:0:10469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10469:1876092408369920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789181330.671477:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181330.671486:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181330.671492:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789181330.671499:0:10469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1dc32aa000 00000020:00000080:1.0:1789181330.671502:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789181330.671587:0:10469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10469:1876092408370048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181330.671620:0:10469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181330.671633:0:10469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.672251:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408370048 00000100:00100000:3.0:1789181330.672259:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408370048 00000100:00100000:3.0:1789181330.672303:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789181330.672312:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:10469:x1876092408370048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181330.672488:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:10469:x1876092408370048:12345-0@lo:502:llog_process_th.0 Request processed in 177us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.672495:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789181330.673235:0:10469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:10469:1876092408370048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789181330.673266:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181330.673274:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181330.673276:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789181330.673281:0:10469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789181330.673954:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789181330.673996:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181330.674008:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.674021:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181330.702024:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408370176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181330.702112:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.702182:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408370176 00000100:00100000:3.0:1789181330.702190:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408370176 00000100:00100000:3.0:1789181330.702249:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181330.702260:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408370176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181330.702292:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181330.702345:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408370176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.702359:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789181330.702381:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181330.702412:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3881c00 x1876092408370176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181330.702432:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408370176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181330.702899:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408370304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181330.702935:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.705074:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408370304 00000100:00100000:3.0:1789181330.705091:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408370304 00000100:00100000:3.0:1789181330.705158:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181330.705170:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408370304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181330.705205:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181330.705288:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408370304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.705295:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789181330.705319:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181330.705352:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3975f80 x1876092408370304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181330.705375:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408370304:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789181330.965219:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181331.301065:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181331.301222:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385238016 00000100:00100000:1.0:1789181331.301233:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385238016 00000100:00100000:1.0:1789181331.301331:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 275 00000100:00100000:1.0:1789181331.301343:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:2393:x1876092385238016:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181331.301413:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:2393:x1876092385238016:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 72us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181331.301420:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 275 00000100:00100000:0.0:1789181331.303468:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181331.303509:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181331.303538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181331.303586:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181331.303591:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385238144 00000100:00100000:3.0:1789181331.303601:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385238144 00000100:00100000:0.0:1789181331.303605:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385238400 00000100:00100000:0.0:1789181331.303608:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385238400 00000100:00100000:3.0:1789181331.303661:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385238272 00000100:00100000:3.0:1789181331.303664:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385238272 00000100:00100000:2.0:1789181331.303697:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385238528 00000100:00100000:2.0:1789181331.303701:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385238528 00000100:00100000:0.0:1789181331.303711:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1789181331.303720:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385238400:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181331.303757:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1789181331.303764:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385238528:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181331.303803:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385238400:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181331.303810:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1789181331.304087:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385238528:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 321us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181331.304094:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00080000:3.0:1789181331.311715:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181331.311890:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181331.311894:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181331.311898:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181331.311930:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:3.0:1789181331.311970:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385238144:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181331.312246:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:0.0:1789181331.312258:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385238272:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181331.312308:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385238272:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 53us (8768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181331.312316:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1789181331.314300:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385238144:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 2327us (10825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181331.314315:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:3.0:1789181331.724838:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181331.724862:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408370432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181331.724937:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181331.725770:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408370432 00000100:00100000:2.0:1789181331.725782:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408370432 00000100:00100000:2.0:1789181331.725843:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789181331.725855:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408370432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789181331.725891:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789181331.725963:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408370432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181331.725970:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789181331.726032:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408370432:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789181331.980058:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181332.236062:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408370560:0@lo:400:kworker.0 00000100:00100000:2.0:1789181332.236179:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181332.236371:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408370560 00000100:00100000:0.0:1789181332.236380:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408370560 00000100:00100000:0.0:1789181332.236430:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789181332.236438:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408370560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181332.243493:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408371072:0@lo:400:kworker.0 00000100:00100000:2.0:1789181332.243584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181332.243960:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408370688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181332.244009:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181332.244067:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408370688 00000100:00100000:3.0:1789181332.244077:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408370688 00000100:00100000:3.0:1789181332.244148:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789181332.244159:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408370688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181332.244192:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181332.244238:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408370688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181332.244245:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789181332.244270:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789181332.244319:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3881880 x1876092408370688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181332.244340:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408370688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181332.244393:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408370816:0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.244421:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181332.244445:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181332.244453:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408370944:0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.244494:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181332.244522:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408370944 00000100:00100000:3.0:1789181332.244526:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408370944 00000100:00100000:3.0:1789181332.244554:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789181332.244561:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408370944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.244610:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408370944:12345-0@lo:400:kworker.0 Request processed in 38us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181332.244617:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789181332.244644:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408370944:0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.244744:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408371072 00000100:00100000:3.0:1789181332.244749:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408371072 00000100:00100000:3.0:1789181332.244773:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408370816 00000100:00100000:3.0:1789181332.244777:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408370816 00000100:00100000:3.0:1789181332.244794:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789181332.244800:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408371072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.244834:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408371072:12345-0@lo:400:kworker.0 Request processed in 34us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181332.244840:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789181332.244851:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789181332.244857:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408370816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.244887:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408370816:12345-0@lo:400:kworker.0 Request processed in 30us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181332.244893:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789181332.244908:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408371200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181332.244929:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181332.244952:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408371200 00000100:00100000:3.0:1789181332.244962:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408371200 00000100:00100000:3.0:1789181332.245003:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789181332.245010:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408371200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181332.245022:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181332.245053:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408371200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181332.245058:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789181332.245073:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789181332.245089:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3881500 x1876092408371200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181332.245102:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408371200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181332.245127:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408370816:0@lo:400:kworker.0 00000100:00100000:0.0:1789181332.246943:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408370560:12345-0@lo:400:kworker.0 Request processed in 10496us (10755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181332.246956:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789181332.247499:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408371328:0@lo:400:kworker.0 00000100:00100000:0.0:1789181332.247553:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181332.247583:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408371840:0@lo:400:kworker.0 00000100:00100000:1.0:1789181332.247687:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408371328 00000100:00100000:1.0:1789181332.247828:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408371328 00000100:00100000:1.0:1789181332.247876:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789181332.247886:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408371328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181332.247937:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408371328:12345-0@lo:400:kworker.0 Request processed in 53us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181332.247958:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789181332.248275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181332.248323:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408371328:0@lo:400:kworker.0 00000100:00100000:0.0:1789181332.248410:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789181332.248420:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408371456:0@lo:400:kworker.0 00000100:00100000:0.0:1789181332.248448:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181332.248471:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408371968:0@lo:400:kworker.0 00000100:00100000:0.0:1789181332.248490:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181332.248517:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408371456 00000100:00100000:0.0:1789181332.248520:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408371456 00000100:00100000:0.0:1789181332.248553:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408371968 00000100:00100000:0.0:1789181332.248556:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408371968 00000100:00100000:0.0:1789181332.248578:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789181332.248585:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408371456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181332.248882:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408371456:12345-0@lo:400:kworker.0 Request processed in 297us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181332.248889:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789181332.248904:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789181332.248911:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408371968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181332.248937:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408371968:12345-0@lo:400:kworker.0 Request processed in 28us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181332.248942:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1789181332.248962:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181332.248997:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408371456:0@lo:400:kworker.0 00000100:00100000:0.0:1789181332.249006:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408371968:0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.249271:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408371712:0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.249310:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181332.249335:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789181332.249458:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408371840 00000100:00100000:0.0:1789181332.249463:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408371840 00000100:00100000:0.0:1789181332.249506:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408371712 00000100:00100000:0.0:1789181332.249510:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408371712 00000100:00100000:0.0:1789181332.249544:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181332.249552:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408371840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.249679:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408371584:0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.249853:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181332.249873:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408372096:0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.249893:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181332.249934:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181332.249943:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408371712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.249991:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408371712:12345-0@lo:400:kworker.0 Request processed in 49us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181332.249997:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789181332.250045:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3976a00 x1876092408371712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181332.250066:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408371712:0@lo:400:kworker.0 00000100:00080000:3.0:1789181332.250241:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181332.250447:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3976680 x1876092408371840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181332.250457:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408371840:0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.250489:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408371584 00000100:00100000:3.0:1789181332.250493:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408371584 00000100:00100000:3.0:1789181332.250527:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408372096 00000100:00100000:3.0:1789181332.250530:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408372096 00000100:00100000:3.0:1789181332.250550:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789181332.250557:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408371584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181332.250867:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408371840:12345-0@lo:400:kworker.0 Request processed in 45us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181332.250879:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181332.250902:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789181332.250912:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408372096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181332.251000:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408371584:12345-0@lo:400:kworker.0 Request processed in 443us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181332.251006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789181332.251090:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181332.251284:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408372096:12345-0@lo:400:kworker.0 Request processed in 373us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181332.251291:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1789181332.251417:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3974a80 x1876092408371584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181332.251429:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408371584:0@lo:400:kworker.0 00010000:00080000:3.0:1789181332.251440:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3977480 x1876092408372096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181332.251447:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408372096:0@lo:400:kworker.0 00000100:00100000:2.0:1789181332.251578:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408370560:0@lo:400:kworker.0 00000100:00100000:2.0:1789181332.251679:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408371072:0@lo:400:kworker.0 00010000:00010000:3.0:1789181333.005424:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181334.036110:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181334.296424:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181334.296448:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408372224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181334.296524:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181334.296593:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408372224 00000100:00100000:1.0:1789181334.296613:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408372224 00000100:00100000:1.0:1789181334.296659:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789181334.296667:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408372224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181334.296701:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181334.296773:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408372224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181334.296780:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789181334.296823:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408372224:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789181335.053664:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181335.826359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408372352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181335.826424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181335.826517:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408372352 00000100:00100000:0.0:1789181335.826526:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408372352 00000100:00100000:0.0:1789181335.827171:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789181335.827184:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408372352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181335.827214:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181335.827266:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408372352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181335.827272:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789181335.827294:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181335.827320:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3879c00 x1876092408372352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181335.827339:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408372352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181335.828215:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181335.828229:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408372480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789181335.828270:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181335.828355:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408372480 00000100:00100000:1.0:1789181335.828361:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408372480 00000100:00100000:1.0:1789181335.828410:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181335.828419:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408372480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789181335.828432:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789181335.828642:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181335.828683:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408372480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 265us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181335.828690:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789181335.828742:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3974700 x1876092408372480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181335.828757:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408372480:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789181336.076930:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181336.422562:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181336.422643:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181336.422674:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181336.422698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181336.422740:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181336.422769:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385239168 00000100:00100000:1.0:1789181336.422779:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385239168 00000100:00100000:1.0:1789181336.422835:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385239040 00000100:00100000:1.0:1789181336.422838:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385239040 00000100:00100000:1.0:1789181336.422871:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1789181336.422882:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385239168:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181336.423690:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385239168:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 804us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181336.423700:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1789181336.423742:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1789181336.423753:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385239040:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181336.423793:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385239040:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181336.423800:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1789181336.423823:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385238912 00000100:00100000:1.0:1789181336.423828:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385238912 00000100:00100000:1.0:1789181336.423908:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385238784 00000100:00100000:1.0:1789181336.423912:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385238784 00000100:00100000:1.0:1789181336.423945:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:1.0:1789181336.423952:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385238912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181336.423981:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385238912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181336.423998:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:1.0:1789181336.424011:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:1.0:1789181336.424017:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385238784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181336.424041:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385238784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181336.424047:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00080000:1.0:1789181336.424065:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181336.424069:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181336.424072:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181336.424074:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181336.426021:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385238656 00000100:00100000:0.0:1789181336.426044:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385238656 00000100:00100000:0.0:1789181336.427511:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 277 00000100:00100000:0.0:1789181336.427528:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385238656:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181336.427606:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385238656:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (5055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181336.427613:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 277 00000001:02000400:1.0:1789181336.577497:0:10696:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1789181336.844701:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408372608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181336.844805:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181336.846012:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408372608 00000100:00100000:2.0:1789181336.846026:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408372608 00000100:00100000:2.0:1789181336.846080:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789181336.846091:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408372608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789181336.846131:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789181336.846201:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408372608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181336.846207:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789181336.846413:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408372608:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789181337.099969:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181337.357138:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408373120:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357224:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357273:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408373632:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357298:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357318:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408374144:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357334:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357355:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789181337.357361:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408372736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181337.357381:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357401:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408373248:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357431:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357447:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408373760:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357466:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357482:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408374272:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357501:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357527:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408372864:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357554:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357575:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408373376:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357597:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357613:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408373888:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357633:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357648:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408374400:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357666:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357682:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789181337.357688:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408372992:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357707:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357746:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408373504:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357767:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181337.357778:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408374016:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.357795:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181337.357938:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408373120 00000100:00100000:2.0:1789181337.357947:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408373120 00000100:00100000:2.0:1789181337.357988:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408373376 00000100:00100000:2.0:1789181337.357991:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408373376 00000100:00100000:2.0:1789181337.358008:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789181337.358016:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408373120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181337.358075:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408373120:12345-0@lo:400:kworker.0 Request processed in 60us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181337.358082:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789181337.358108:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789181337.358114:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408373376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181337.358150:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408373376:12345-0@lo:400:kworker.0 Request processed in 36us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181337.358156:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789181337.358194:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408373376:0@lo:400:kworker.0 00000100:00100000:2.0:1789181337.358220:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408373120:0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.358915:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408373632 00000100:00100000:1.0:1789181337.358922:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408373632 00000100:00100000:1.0:1789181337.359046:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408374144 00000100:00100000:1.0:1789181337.359050:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408374144 00000100:00100000:1.0:1789181337.359063:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408373248 00000100:00100000:1.0:1789181337.359072:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408373248 00000100:00100000:1.0:1789181337.359085:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408372992 00000100:00100000:1.0:1789181337.359088:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408372992 00000100:00100000:1.0:1789181337.359096:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408373504 00000100:00100000:1.0:1789181337.359099:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408373504 00000100:00100000:1.0:1789181337.359110:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408374016 00000100:00100000:1.0:1789181337.359112:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408374016 00000100:00100000:1.0:1789181337.359127:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789181337.359134:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408373632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.359185:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408373632:12345-0@lo:400:kworker.0 Request processed in 52us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181337.359191:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789181337.359203:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789181337.359208:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408374144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.359232:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408374144:12345-0@lo:400:kworker.0 Request processed in 24us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181337.359236:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789181337.359246:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789181337.359251:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408373248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.359273:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408373248:12345-0@lo:400:kworker.0 Request processed in 22us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181337.359277:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789181337.359286:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789181337.359291:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408372992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.359319:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408372992:12345-0@lo:400:kworker.0 Request processed in 27us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181337.359324:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789181337.359343:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789181337.359348:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408373504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.359376:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408373504:12345-0@lo:400:kworker.0 Request processed in 28us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181337.359381:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789181337.359391:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789181337.359396:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408374016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.359420:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408374016:12345-0@lo:400:kworker.0 Request processed in 25us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181337.359425:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789181337.359459:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408372736 00000100:00100000:1.0:1789181337.359463:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408372736 00000100:00100000:1.0:1789181337.359487:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181337.359492:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408372736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789181337.359524:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181337.359555:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408372736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181337.359562:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181337.359582:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408373760 00000100:00100000:1.0:1789181337.359585:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408373760 00000100:00100000:1.0:1789181337.359602:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408374272 00000100:00100000:1.0:1789181337.359604:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408374272 00000100:00100000:1.0:1789181337.359612:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408373888 00000100:00100000:1.0:1789181337.359614:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408373888 00000100:00100000:1.0:1789181337.359625:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408374400 00000100:00100000:1.0:1789181337.359627:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408374400 00000100:00100000:1.0:1789181337.359638:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789181337.359643:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408373760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.359680:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408373760:12345-0@lo:400:kworker.0 Request processed in 36us (2212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181337.359686:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789181337.359698:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789181337.359704:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408374272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181337.359747:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408374272:12345-0@lo:400:kworker.0 Request processed in 43us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181337.359752:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789181337.360784:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181337.360790:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181337.360793:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181337.360795:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181337.360825:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789181337.360839:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408373888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181337.360905:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408373888:12345-0@lo:400:kworker.0 Request processed in 72us (3271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181337.360912:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789181337.360940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789181337.360947:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408374400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181337.360975:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408374400:12345-0@lo:400:kworker.0 Request processed in 29us (3308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181337.360981:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789181337.361026:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408372992:0@lo:400:kworker.0 00000100:00100000:3.0:1789181337.361038:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408373504:0@lo:400:kworker.0 00000100:00100000:3.0:1789181337.361048:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408374016:0@lo:400:kworker.0 00010000:00080000:3.0:1789181337.361061:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3974000 x1876092408373888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181337.361072:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408373888:0@lo:400:kworker.0 00010000:00080000:3.0:1789181337.361082:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dfb80 x1876092408374400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181337.361089:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408374400:0@lo:400:kworker.0 00010000:00080000:3.0:1789181337.361122:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3976a00 x1876092408372736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181337.361150:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408372736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181337.361166:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408373248:0@lo:400:kworker.0 00010000:00080000:3.0:1789181337.361178:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3977100 x1876092408373760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181337.361184:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408373760:0@lo:400:kworker.0 00010000:00080000:3.0:1789181337.361192:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5df480 x1876092408374272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181337.361199:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408374272:0@lo:400:kworker.0 00010000:00080000:3.0:1789181337.361207:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3975880 x1876092408373632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181337.361214:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408373632:0@lo:400:kworker.0 00010000:00080000:3.0:1789181337.361222:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dea00 x1876092408374144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181337.361229:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408374144:0@lo:400:kworker.0 00000100:00100000:0.0:1789181337.361587:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408374528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181337.361629:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181337.361675:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408372864 00000100:00100000:0.0:1789181337.361681:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408372864 00000100:00100000:0.0:1789181337.361718:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789181337.361749:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408372864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181337.361786:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408372864:12345-0@lo:400:kworker.0 Request processed in 38us (4230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181337.361791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789181337.361989:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408374528 00000100:00100000:1.0:1789181337.361993:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408374528 00000100:00100000:1.0:1789181337.362014:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789181337.362020:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408374528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181337.362033:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181337.362072:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408374528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181337.362078:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789181337.363084:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3879c00 x1876092408374528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181337.363104:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408374528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181337.363331:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408372864:0@lo:400:kworker.0 00010000:00010000:3.0:1789181338.126168:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181339.149091:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181339.405140:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408374656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181339.405242:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181339.405651:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408374656 00000100:00100000:1.0:1789181339.405663:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408374656 00000100:00100000:1.0:1789181339.405751:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789181339.405762:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408374656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181339.405801:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181339.405870:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408374656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181339.405877:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789181339.405964:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408374656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789181340.172198:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181340.947271:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408374784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181340.947365:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181340.947451:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408374784 00000100:00100000:3.0:1789181340.947461:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408374784 00000100:00100000:3.0:1789181340.947519:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789181340.947529:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408374784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181340.947561:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181340.947607:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408374784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181340.947614:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789181340.947635:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181340.947663:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3881500 x1876092408374784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181340.947682:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408374784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181340.949406:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181340.949424:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408374912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181340.949476:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181340.949511:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408374912 00000100:00100000:3.0:1789181340.949517:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408374912 00000100:00100000:3.0:1789181340.949557:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789181340.949565:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408374912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181340.949582:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181340.949621:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408374912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181340.949628:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789181340.949647:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181340.949670:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3881500 x1876092408374912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181340.949696:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408374912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789181341.196259:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181341.551237:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181341.551288:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181341.551378:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385239680 00000100:00100000:3.0:1789181341.551390:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385239680 00000100:00100000:3.0:1789181341.551468:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385239808 00000100:00100000:3.0:1789181341.551473:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385239808 00000100:00100000:3.0:1789181341.551503:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1789181341.551514:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2392:x1876092385239680:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:3.0:1789181341.551554:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516fb7 00000100:00080000:3.0:1789181341.551567:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf43000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789181341.551616:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789181341.551849:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+2:2392:x1876092385239680:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 335us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181341.551857:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1789181341.551875:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1789181341.551882:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2392:x1876092385239808:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:3.0:1789181341.551908:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516fbe 00000100:00080000:3.0:1789181341.551917:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c1cc3926000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789181341.551941:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789181341.552018:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+2:2392:x1876092385239808:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 136us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181341.552025:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00010000:00010000:3.0:1789181341.552054:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181341.552183:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181341.552586:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181341.552591:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181341.555548:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181341.555596:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181341.555632:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181341.555670:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385239552 00000100:00100000:0.0:1789181341.555680:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385239552 00000100:00100000:0.0:1789181341.555790:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385239424 00000100:00100000:0.0:1789181341.555794:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385239424 00000100:00100000:0.0:1789181341.555837:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1789181341.555848:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385239552:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181341.555941:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385239552:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181341.555948:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:0.0:1789181341.555967:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:0.0:1789181341.555974:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385239424:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181341.556001:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385239424:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181341.556007:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00080000:0.0:1789181341.556027:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181341.556032:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181341.556585:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385239296 00000100:00100000:2.0:1789181341.556592:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385239296 00000100:00100000:2.0:1789181341.556705:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 279 00000100:00100000:2.0:1789181341.556714:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:2393:x1876092385239296:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181341.556790:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:2393:x1876092385239296:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 76us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181341.556798:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 279 00000001:02000400:1.0:1789181341.564616:0:10940:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing yml_node 00000100:00100000:3.0:1789181341.963970:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408375040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181341.964639:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181341.964749:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408375040 00000100:00100000:3.0:1789181341.964758:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408375040 00000100:00100000:3.0:1789181341.964821:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789181341.964831:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408375040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181341.964870:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789181341.964933:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408375040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181341.964941:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789181341.964990:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408375040:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789181342.221931:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181342.476290:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181342.476317:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408375168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181342.476390:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181342.476495:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408375168 00000100:00100000:0.0:1789181342.476503:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408375168 00000100:00100000:0.0:1789181342.476570:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789181342.476580:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408375168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181342.476606:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181342.476647:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408375168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181342.476652:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789181342.476692:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3879500 x1876092408375168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181342.476706:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408375168:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789181342.476771:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181342.476933:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408375680:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.476968:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181342.476990:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408376192:0@lo:400:kworker.0 00000100:00100000:0.0:1789181342.477090:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408375296:0@lo:400:kworker.0 00000100:00100000:0.0:1789181342.477121:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181342.477156:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408375808:0@lo:400:kworker.0 00000100:00100000:0.0:1789181342.477180:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181342.477198:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408376320:0@lo:400:kworker.0 00000100:00100000:0.0:1789181342.477217:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181342.477247:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408375296 00000100:00100000:0.0:1789181342.477251:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408375296 00000100:00100000:0.0:1789181342.477276:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789181342.477282:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408375296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181342.477316:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408375296:12345-0@lo:400:kworker.0 Request processed in 34us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181342.477322:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789181342.477349:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408375808 00000100:00100000:0.0:1789181342.477353:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408375808 00000100:00100000:0.0:1789181342.477377:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789181342.477383:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408375808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181342.477415:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408375808:12345-0@lo:400:kworker.0 Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181342.477421:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789181342.477439:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408376320 00000100:00100000:0.0:1789181342.477442:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408376320 00000100:00100000:0.0:1789181342.477474:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181342.477480:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408376320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181342.477509:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408376320:12345-0@lo:400:kworker.0 Request processed in 29us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181342.477514:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789181342.477533:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181342.477551:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408375296:0@lo:400:kworker.0 00000100:00100000:0.0:1789181342.477570:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408375808:0@lo:400:kworker.0 00010000:00080000:0.0:1789181342.477579:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb2a8e00 x1876092408376320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181342.477588:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408376320:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478170:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181342.478242:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408376704:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478265:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181342.478358:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408375424:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478384:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181342.478404:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408375936:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478423:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181342.478439:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408376448:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478456:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181342.478476:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789181342.478482:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408375552:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478504:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181342.478523:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408376064:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478543:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181342.478552:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408376576:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478568:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181342.478591:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408375680 00000100:00100000:1.0:1789181342.478597:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408375680 00000100:00100000:1.0:1789181342.478633:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408375424 00000100:00100000:1.0:1789181342.478636:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408375424 00000100:00100000:1.0:1789181342.478646:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408375936 00000100:00100000:1.0:1789181342.478648:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408375936 00000100:00100000:1.0:1789181342.478669:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408376448 00000100:00100000:1.0:1789181342.478672:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408376448 00000100:00100000:1.0:1789181342.478685:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408376064 00000100:00100000:1.0:1789181342.478687:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408376064 00000100:00100000:1.0:1789181342.478699:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408376576 00000100:00100000:1.0:1789181342.478701:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408376576 00000100:00100000:1.0:1789181342.478716:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789181342.478741:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408375680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478785:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408375680:12345-0@lo:400:kworker.0 Request processed in 63us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181342.478791:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789181342.478806:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789181342.478811:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408375424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478840:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408375424:12345-0@lo:400:kworker.0 Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181342.478847:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789181342.478858:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789181342.478864:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408375936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478902:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408375936:12345-0@lo:400:kworker.0 Request processed in 37us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181342.478908:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789181342.478918:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789181342.478924:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408376448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.478948:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408376448:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181342.478960:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789181342.478972:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789181342.478977:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408376064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.479125:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408376064:12345-0@lo:400:kworker.0 Request processed in 147us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181342.479131:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789181342.479143:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789181342.479149:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408376576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.479176:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408376576:12345-0@lo:400:kworker.0 Request processed in 28us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181342.479182:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789181342.479218:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408375552 00000100:00100000:1.0:1789181342.479223:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408375552 00000100:00100000:1.0:1789181342.479248:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789181342.479254:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408375552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.479285:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408375552:12345-0@lo:400:kworker.0 Request processed in 31us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181342.479290:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789181342.479307:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181342.479310:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181342.479388:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408376192 00000100:00100000:2.0:1789181342.479394:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408376192 00000100:00100000:2.0:1789181342.479429:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408376704 00000100:00100000:2.0:1789181342.479432:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408376704 00000100:00100000:2.0:1789181342.479453:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789181342.479460:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408376192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181342.479494:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408376192:12345-0@lo:400:kworker.0 Request processed in 35us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181342.479511:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789181342.479526:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789181342.479532:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408376704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181342.479559:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408376704:12345-0@lo:400:kworker.0 Request processed in 28us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181342.479565:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789181342.479790:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408375680:0@lo:400:kworker.0 00010000:00080000:2.0:1789181342.479803:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbd880 x1876092408376192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181342.479814:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408376192:0@lo:400:kworker.0 00010000:00080000:2.0:1789181342.479822:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb2ab100 x1876092408376704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181342.479829:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408376704:0@lo:400:kworker.0 00000100:00100000:2.0:1789181342.479844:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181342.479851:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408376832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181342.479890:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789181342.479965:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181342.479968:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181342.479987:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408375552:0@lo:400:kworker.0 00000100:00100000:0.0:1789181342.480086:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408376832 00000100:00100000:0.0:1789181342.480091:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408376832 00010000:00080000:1.0:1789181342.480155:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbf800 x1876092408376064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181342.480165:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408376064:0@lo:400:kworker.0 00010000:00080000:1.0:1789181342.480185:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb2a9880 x1876092408376576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181342.480192:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408376576:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.480202:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408375424:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.480211:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408375936:0@lo:400:kworker.0 00000100:00100000:1.0:1789181342.480222:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408376448:0@lo:400:kworker.0 00000100:00100000:0.0:1789181342.480268:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789181342.480278:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408376832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181342.480295:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181342.480344:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408376832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181342.480350:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789181342.480399:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34fa300 x1876092408376832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181342.480414:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408376832:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789181343.246045:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181344.270804:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181344.524131:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408376960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789181344.524200:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181344.524345:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408376960 00000100:00100000:0.0:1789181344.524353:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408376960 00000100:00100000:0.0:1789181344.524399:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789181344.524406:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408376960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789181344.524439:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789181344.524476:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408376960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181344.524481:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789181344.524812:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408376960:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789181345.295405:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181346.060617:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408377088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181346.060690:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181346.060780:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408377088 00000100:00100000:3.0:1789181346.060788:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408377088 00000100:00100000:3.0:1789181346.060841:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181346.060864:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408377088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181346.060895:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181346.060941:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408377088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181346.060948:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789181346.060987:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3881f80 x1876092408377088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181346.061005:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408377088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181346.061212:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181346.061221:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408377216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181346.061249:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181346.061278:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408377216 00000100:00100000:0.0:1789181346.061282:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408377216 00000100:00100000:0.0:1789181346.061313:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789181346.061319:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408377216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181346.061343:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181346.061372:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408377216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181346.061378:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789181346.061404:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc387a300 x1876092408377216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181346.061417:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408377216:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789181346.061444:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789181346.319796:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789181346.484420:0:11123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:3.0:1789181346.664861:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181346.664909:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181346.664940:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181346.664969:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385240192 00000100:00100000:3.0:1789181346.664979:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385240192 00000100:00100000:3.0:1789181346.665042:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385240064 00000100:00100000:3.0:1789181346.665046:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385240064 00000100:00100000:3.0:1789181346.665070:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1789181346.665081:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385240192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181346.665165:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385240192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181346.665172:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1789181346.665189:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:3.0:1789181346.665196:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385240064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181346.665221:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385240064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181346.665227:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00080000:3.0:1789181346.665246:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181346.665250:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181346.669853:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385239936 00000100:00100000:0.0:1789181346.669871:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385239936 00000100:00100000:0.0:1789181346.670084:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:0.0:1789181346.670097:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385239936:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181346.670199:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385239936:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 106us (5359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181346.670208:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 281 00000100:00100000:0.0:1789181347.085533:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181347.085564:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408377344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181347.085651:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181347.085748:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408377344 00000100:00100000:0.0:1789181347.085756:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408377344 00000100:00100000:0.0:1789181347.085805:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789181347.085814:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408377344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181347.085866:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789181347.085925:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408377344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181347.085932:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789181347.086222:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408377344:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1789181347.090249:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:0.0:1789181347.090258:0:9516:0:(genops.c:885:class_export_put()) final put ffff9c1cc3924000/3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:0.0:1789181347.090282:0:254:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc3924000/3c4ab02e-ed68-4ee0-b458-d9073baffb59 for lustre-OST0001 00000020:00000080:0.0:1789181347.090322:0:254:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc3926000 for lustre-OST0001 00000001:00100000:2.0:1789181347.096202:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:2.0:1789181347.096211:0:8431:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf26000/3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:2.0:1789181347.096241:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf26000/3c4ab02e-ed68-4ee0-b458-d9073baffb59 for lustre-OST0000 00000020:00000080:2.0:1789181347.096282:0:27:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1dfaf43000 for lustre-OST0000 00010000:00010000:3.0:1789181347.340604:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181347.603086:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408377472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181347.603166:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603216:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408377984:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603239:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603255:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408378496:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603286:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603306:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408379008:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603323:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603349:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789181347.603354:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408377600:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603377:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603393:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408378112:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603423:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603440:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408378624:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603456:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603485:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408377856:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603504:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603519:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408378368:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603534:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603546:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408378880:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603561:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603575:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789181347.603579:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408377728:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603599:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603614:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408378240:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603631:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603640:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408378752:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603657:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.603682:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408378496 00000100:00100000:1.0:1789181347.603692:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408378496 00000100:00100000:1.0:1789181347.603750:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408379008 00000100:00100000:1.0:1789181347.603753:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408379008 00000100:00100000:1.0:1789181347.603775:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408378368 00000100:00100000:1.0:1789181347.603778:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408378368 00000100:00100000:1.0:1789181347.603788:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408378880 00000100:00100000:1.0:1789181347.603790:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408378880 00000100:00100000:1.0:1789181347.603807:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789181347.603815:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408378496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603891:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408378496:12345-0@lo:400:kworker.0 Request processed in 77us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.603899:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789181347.603917:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789181347.603923:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408379008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.603950:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408379008:12345-0@lo:400:kworker.0 Request processed in 28us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.603955:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789181347.603966:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789181347.603971:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408378368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604000:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408378368:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.604005:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789181347.604016:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789181347.604022:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408378880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604047:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408378880:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.604053:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789181347.604069:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408378112 00000100:00100000:1.0:1789181347.604073:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408378112 00000100:00100000:1.0:1789181347.604093:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408378624 00000100:00100000:1.0:1789181347.604095:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408378624 00000100:00100000:1.0:1789181347.604106:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408377856 00000100:00100000:1.0:1789181347.604108:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408377856 00000100:00100000:1.0:1789181347.604116:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408377728 00000100:00100000:1.0:1789181347.604118:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408377728 00000100:00100000:1.0:1789181347.604125:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408378240 00000100:00100000:1.0:1789181347.604135:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408378240 00000100:00100000:1.0:1789181347.604150:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408378752 00000100:00100000:1.0:1789181347.604151:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408378752 00000100:00100000:1.0:1789181347.604162:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789181347.604167:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408378112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604195:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408378112:12345-0@lo:400:kworker.0 Request processed in 28us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.604200:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789181347.604210:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789181347.604215:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408378624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604239:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408378624:12345-0@lo:400:kworker.0 Request processed in 24us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.604244:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789181347.604254:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789181347.604259:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408377856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604284:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408377856:12345-0@lo:400:kworker.0 Request processed in 24us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.604289:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789181347.604299:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789181347.604305:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408377728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604329:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408377728:12345-0@lo:400:kworker.0 Request processed in 24us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.604334:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789181347.604343:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789181347.604348:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408378240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604370:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408378240:12345-0@lo:400:kworker.0 Request processed in 22us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.604381:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789181347.604391:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789181347.604396:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408378752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604420:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408378752:12345-0@lo:400:kworker.0 Request processed in 24us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.604424:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789181347.604451:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181347.604455:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181347.604457:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181347.604491:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408377728:0@lo:400:kworker.0 00010000:00080000:1.0:1789181347.604503:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc255b480 x1876092408378240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181347.604512:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408378240:0@lo:400:kworker.0 00010000:00080000:1.0:1789181347.604520:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5df480 x1876092408378752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181347.604527:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408378752:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604535:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408377856:0@lo:400:kworker.0 00010000:00080000:1.0:1789181347.604543:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc255ad80 x1876092408378368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181347.604549:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408378368:0@lo:400:kworker.0 00010000:00080000:1.0:1789181347.604556:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dfb80 x1876092408378880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181347.604563:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408378880:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604612:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408378112:0@lo:400:kworker.0 00000100:00100000:1.0:1789181347.604621:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408378624:0@lo:400:kworker.0 00010000:00080000:1.0:1789181347.604630:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc255b100 x1876092408378496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181347.604637:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408378496:0@lo:400:kworker.0 00010000:00080000:1.0:1789181347.604644:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5de300 x1876092408379008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181347.604648:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408377984 00000100:00100000:1.0:1789181347.604651:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408379008:0@lo:400:kworker.0 00000100:00100000:3.0:1789181347.604652:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408377984 00000100:00100000:3.0:1789181347.604679:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789181347.604686:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408377984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181347.604739:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408377984:12345-0@lo:400:kworker.0 Request processed in 36us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.604744:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408377984:0@lo:400:kworker.0 00000100:00100000:3.0:1789181347.604754:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789181347.604982:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408377472 00000100:00100000:0.0:1789181347.604987:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408377472 00000100:00100000:0.0:1789181347.605024:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789181347.605031:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408377472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181347.605053:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181347.605092:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408377472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181347.605098:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789181347.605122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408377600 00000100:00100000:0.0:1789181347.605126:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408377600 00000100:00100000:0.0:1789181347.605151:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789181347.605157:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408377600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181347.605184:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408377600:12345-0@lo:400:kworker.0 Request processed in 28us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181347.605190:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789181347.605394:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408377600:0@lo:400:kworker.0 00010000:00080000:0.0:1789181347.605406:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360d880 x1876092408377472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181347.605432:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408377472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181347.608206:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408379136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181347.608270:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181347.609967:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408379136 00000100:00100000:1.0:1789181347.609981:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408379136 00000100:00100000:1.0:1789181347.610036:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789181347.610047:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408379136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181347.610073:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181347.610155:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408379136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181347.610161:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789181347.611227:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3883480 x1876092408379136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181347.611254:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408379136:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789181348.366691:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789181348.960476:0:11221:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:0.0:1789181349.387929:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181349.651146:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408379264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181349.651218:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181349.651314:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408379264 00000100:00100000:1.0:1789181349.651323:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408379264 00000100:00100000:1.0:1789181349.651371:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789181349.651381:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408379264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181349.651420:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181349.665959:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408379264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 14568us (14729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181349.665983:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789181349.667628:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408379264:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789181350.411958:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789181351.104849:0:11318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:3.0:1789181351.180874:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181351.180899:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408379392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181351.180968:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181351.184134:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408379520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789181351.184204:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181351.186405:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408379392 00000100:00100000:1.0:1789181351.186422:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408379392 00000100:00100000:1.0:1789181351.186493:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408379520 00000100:00100000:1.0:1789181351.186497:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408379520 00000100:00100000:1.0:1789181351.186523:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789181351.186533:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408379392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181351.186580:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181351.186681:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408379392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (5712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181351.186689:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789181351.186707:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789181351.186713:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408379520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789181351.186750:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181351.186779:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408379520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181351.186785:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789181351.186817:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181351.186914:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c7b80 x1876092408379392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181351.186938:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408379392:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789181351.202028:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34f9880 x1876092408379520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181351.202059:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408379520:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789181351.442378:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181351.783309:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181351.783365:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181351.783504:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385240448 00000100:00100000:1.0:1789181351.783519:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385240448 00000100:00100000:1.0:1789181351.783614:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1789181351.783625:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385240448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181351.783698:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385240448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 75us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181351.783706:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00080000:3.0:1789181351.783888:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181351.784224:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385240320 00000100:00100000:2.0:1789181351.784231:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385240320 00000100:00100000:2.0:1789181351.784271:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 283 00000100:00100000:2.0:1789181351.784278:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385240320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181351.784324:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385240320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 46us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181351.784330:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 283 00000100:00100000:3.0:1789181351.803845:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181351.810100:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385240576 00000100:00100000:1.0:1789181351.810117:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385240576 00000100:00100000:1.0:1789181351.810218:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:1.0:1789181351.810230:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385240576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181351.810314:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385240576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 87us (6484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181351.810322:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00080000:3.0:1789181351.811605:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181352.204054:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408379648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181352.204124:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181352.204267:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408379648 00000100:00100000:3.0:1789181352.204285:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408379648 00000100:00100000:3.0:1789181352.204342:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789181352.204354:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408379648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181352.204396:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789181352.204446:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408379648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181352.204453:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789181352.204665:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408379648:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789181352.460427:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181352.716232:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408379904:0@lo:400:kworker.0 00000100:00100000:1.0:1789181352.716265:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408380032:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.716409:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.716477:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408380416:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.716501:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.716537:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408380928:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.716564:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.716586:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789181352.716592:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408379776:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.716620:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.716644:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408380288:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.716663:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.716675:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408380800:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.716692:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.716707:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408380160:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.716756:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.716776:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408380672:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.716809:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.716831:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408381184:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.716856:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.716933:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408379904 00000100:00100000:2.0:1789181352.716941:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408379904 00000100:00100000:2.0:1789181352.716979:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408380416 00000100:00100000:2.0:1789181352.716982:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408380416 00000100:00100000:0.0:1789181352.717001:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408380672 00000100:00100000:0.0:1789181352.717008:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408380672 00000100:00100000:2.0:1789181352.717011:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408380928 00000100:00100000:2.0:1789181352.717015:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408380928 00000100:00100000:2.0:1789181352.717033:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408380288 00000100:00100000:2.0:1789181352.717034:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408380288 00000100:00100000:2.0:1789181352.717051:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408380800 00000100:00100000:2.0:1789181352.717053:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408380800 00000100:00100000:0.0:1789181352.717053:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408381184 00000100:00100000:0.0:1789181352.717059:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408381184 00000100:00100000:0.0:1789181352.717087:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789181352.717097:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408380672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717121:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789181352.717128:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408379904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181352.717165:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408380672:12345-0@lo:400:kworker.0 Request processed in 68us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.717176:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408379904:12345-0@lo:400:kworker.0 Request processed in 48us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181352.717176:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789181352.717186:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789181352.717206:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789181352.717207:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789181352.717215:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408380416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181352.717221:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408381184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717236:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408380416:12345-0@lo:400:kworker.0 Request processed in 20us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.717242:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789181352.717259:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789181352.717265:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408381184:12345-0@lo:400:kworker.0 Request processed in 46us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.717269:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408380928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181352.717276:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789181352.717306:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408380928:12345-0@lo:400:kworker.0 Request processed in 41us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.717312:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789181352.717321:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789181352.717324:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408380288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717340:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408380288:12345-0@lo:400:kworker.0 Request processed in 16us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.717343:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789181352.717348:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789181352.717351:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408380800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717364:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408380800:12345-0@lo:400:kworker.0 Request processed in 12us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.717367:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789181352.717382:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408379776 00000100:00100000:2.0:1789181352.717384:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408379776 00000100:00100000:2.0:1789181352.717415:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789181352.717419:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408379776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717438:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408379776:12345-0@lo:400:kworker.0 Request processed in 20us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.717442:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:2.0:1789181352.717481:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181352.717485:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181352.717487:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181352.717496:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408381312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181352.717515:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789181352.717559:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3970e00 x1876092408380672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181352.717571:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408380672:0@lo:400:kworker.0 00010000:00080000:2.0:1789181352.717578:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dfb80 x1876092408381184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181352.717583:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408381184:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717616:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408379776:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717622:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408380288:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717627:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408380800:0@lo:400:kworker.0 00010000:00080000:2.0:1789181352.717632:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5de300 x1876092408380928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181352.717638:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408380928:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717643:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408379904:0@lo:400:kworker.0 00010000:00080000:2.0:1789181352.717655:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3973b80 x1876092408380416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181352.717660:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408380416:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717695:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408380160 00000100:00100000:2.0:1789181352.717698:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408380160 00000100:00100000:2.0:1789181352.717716:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789181352.717745:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408380160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717782:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408380160:12345-0@lo:400:kworker.0 Request processed in 61us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.717797:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789181352.717823:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408380160:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.717869:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181352.717874:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408381440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181352.717896:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.717920:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408381312 00000100:00100000:2.0:1789181352.717924:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408381312 00000100:00100000:2.0:1789181352.717940:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408381440 00000100:00100000:2.0:1789181352.717943:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408381440 00000100:00100000:2.0:1789181352.717962:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181352.717967:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408381312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181352.717988:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181352.718015:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408381312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.718018:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181352.718026:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181352.718030:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408381440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789181352.718041:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181352.718057:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408381440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 27us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.718118:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789181352.718130:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789181352.718142:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3974e00 x1876092408381440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181352.718151:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408381440:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789181352.718156:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3975880 x1876092408381312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181352.718163:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408381312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181352.727089:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181352.727166:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408380544:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.727192:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408380032 00000100:00100000:2.0:1789181352.727207:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408380032 00000100:00100000:1.0:1789181352.727233:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181352.727254:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408381056:0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.727281:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789181352.727294:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408380032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181352.727302:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181352.727377:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408380032:12345-0@lo:400:kworker.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.727386:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789181352.733556:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408380544 00000100:00100000:0.0:1789181352.733581:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408380544 00000100:00100000:0.0:1789181352.733652:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408381056 00000100:00100000:0.0:1789181352.733656:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408381056 00000100:00100000:0.0:1789181352.733692:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789181352.733703:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408380544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181352.733706:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789181352.733751:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408381056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181352.733869:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408380544:12345-0@lo:400:kworker.0 Request processed in 168us (6635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181352.733878:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789181352.733909:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408381056:12345-0@lo:400:kworker.0 Request processed in 193us (6609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181352.733917:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789181352.734645:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dea00 x1876092408381056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181352.734660:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408381056:0@lo:400:kworker.0 00000100:00100000:1.0:1789181352.734689:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408380032:0@lo:400:kworker.0 00010000:00080000:1.0:1789181352.734699:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3971c00 x1876092408380544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181352.734707:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408380544:0@lo:400:kworker.0 00000001:02000400:2.0:1789181353.185493:0:11366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 22:49:11 EDT 2026 00010000:00010000:0.0:1789181353.484115:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181354.514324:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181354.768232:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408381568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181354.768329:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181354.768475:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408381568 00000100:00100000:1.0:1789181354.768484:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408381568 00000100:00100000:1.0:1789181354.768574:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789181354.768584:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408381568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181354.768622:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181354.768685:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408381568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181354.768693:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789181354.768779:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408381568:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789181355.536157:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181356.300169:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408381696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181356.304583:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181356.304617:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408381824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181356.307348:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181356.307652:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408381824 00000100:00100000:3.0:1789181356.307663:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408381824 00000100:00100000:3.0:1789181356.307849:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789181356.307869:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408381824:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181356.307954:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789181356.308020:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181356.308130:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408381824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 263us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181356.308137:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789181356.312045:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181356.312249:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408381696 00000100:00100000:1.0:1789181356.312261:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408381696 00000100:00100000:1.0:1789181356.312323:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789181356.312335:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408381696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789181356.312364:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181356.312440:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408381696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181356.312447:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789181356.312521:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789181356.312556:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3975880 x1876092408381696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181356.312576:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408381696:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789181356.319075:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dea00 x1876092408381824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181356.319105:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408381824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789181356.563092:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181356.901795:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181356.901841:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181356.901973:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181356.902044:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385240704 00000100:00100000:1.0:1789181356.902062:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385240704 00000100:00100000:1.0:1789181356.902157:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 285 00000100:00100000:1.0:1789181356.902173:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385240704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181356.902312:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385240704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 143us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181356.902320:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 285 00000100:00100000:2.0:1789181356.909521:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385240960 00000100:00100000:2.0:1789181356.909538:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385240960 00000100:00100000:3.0:1789181356.909803:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385240832 00000100:00100000:3.0:1789181356.909808:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385240832 00000100:00100000:3.0:1789181356.909837:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1789181356.909849:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385240960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181356.909949:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385240960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 102us (8105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181356.909956:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1789181356.909985:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:3.0:1789181356.909991:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385240832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181356.910012:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385240832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (8040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181356.910018:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00080000:2.0:1789181356.910166:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181356.910170:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789181357.324819:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181357.324861:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408381952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181357.324941:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.325032:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408381952 00000100:00100000:1.0:1789181357.325043:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408381952 00000100:00100000:1.0:1789181357.325094:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789181357.325104:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408381952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181357.325143:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789181357.325188:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408381952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.325195:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789181357.325242:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408381952:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789181357.579931:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181357.836090:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408382208:0@lo:400:kworker.0 00000100:00100000:0.0:1789181357.836677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.836794:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408382080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181357.836829:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.837174:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408382336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181357.837208:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.837236:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181357.837242:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408382720:0@lo:400:kworker.0 00000100:00100000:2.0:1789181357.837287:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.837323:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408382080 00000100:00100000:2.0:1789181357.837331:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408382080 00000100:00100000:2.0:1789181357.837393:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408382336 00000100:00100000:2.0:1789181357.837396:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408382336 00000100:00100000:2.0:1789181357.837416:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789181357.837425:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408382080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181357.837455:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181357.847069:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408382720 00000100:00100000:3.0:1789181357.847096:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408382720 00000100:00100000:3.0:1789181357.847166:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789181357.847177:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408382720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181357.847288:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408382720:12345-0@lo:400:kworker.0 Request processed in 113us (9999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.847310:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789181357.847364:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408382720:0@lo:400:kworker.0 00000100:00080000:3.0:1789181357.854440:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181357.854506:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408382592:0@lo:400:kworker.0 00000100:00100000:3.0:1789181357.854598:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181357.854644:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181357.854651:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408382464:0@lo:400:kworker.0 00000100:00100000:2.0:1789181357.855031:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408382080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17604us (18198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181357.855043:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789181357.855094:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789181357.855107:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408382336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789181357.855134:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181357.856164:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181357.856253:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408382208 00000100:00100000:3.0:1789181357.856263:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408382208 00000100:00100000:3.0:1789181357.856315:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789181357.856325:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408382208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181357.856366:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408382208:12345-0@lo:400:kworker.0 Request processed in 43us (19691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.856372:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789181357.856416:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408382592 00000100:00100000:3.0:1789181357.856421:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408382592 00000100:00100000:3.0:1789181357.856452:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408382464 00000100:00100000:3.0:1789181357.856455:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408382464 00000100:00100000:3.0:1789181357.856473:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789181357.856480:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408382592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181357.856523:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408382592:12345-0@lo:400:kworker.0 Request processed in 43us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.856529:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789181357.856542:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789181357.856548:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408382464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181357.856638:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408382464:12345-0@lo:400:kworker.0 Request processed in 90us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.856645:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789181357.856696:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408382464:0@lo:400:kworker.0 00000100:00100000:3.0:1789181357.856709:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408382592:0@lo:400:kworker.0 00010000:00080000:0.0:1789181357.858457:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3975880 x1876092408382080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181357.858486:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408382080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181357.859097:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408382208:0@lo:400:kworker.0 00000100:00100000:2.0:1789181357.865219:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408382336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10107us (28000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181357.865235:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789181357.867788:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181357.867811:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408382976:0@lo:400:kworker.0 00000100:00100000:1.0:1789181357.867904:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.867975:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408382976 00000100:00100000:1.0:1789181357.867985:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408382976 00000100:00100000:1.0:1789181357.868053:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789181357.868063:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408382976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181357.868117:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408382976:12345-0@lo:400:kworker.0 Request processed in 56us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.868124:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1789181357.868143:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789181357.868171:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360d500 x1876092408382976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181357.868185:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408382976:0@lo:400:kworker.0 00000100:00100000:2.0:1789181357.868320:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181357.868373:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181357.868385:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408382848:0@lo:400:kworker.0 00000100:00100000:0.0:1789181357.868415:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.868440:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408382848 00000100:00100000:0.0:1789181357.868456:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408382848 00000100:00100000:0.0:1789181357.868485:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789181357.868491:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408382848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181357.868752:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408382848:12345-0@lo:400:kworker.0 Request processed in 228us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181357.868759:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789181357.868791:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408382848:0@lo:400:kworker.0 00000100:00080000:0.0:1789181357.868823:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181357.869016:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408383232:0@lo:400:kworker.0 00000100:00100000:0.0:1789181357.869047:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.869072:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408383232 00000100:00100000:0.0:1789181357.869076:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408383232 00000100:00100000:0.0:1789181357.869104:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789181357.869110:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408383232:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789181357.869214:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c7100 x1876092408382336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181357.869240:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408382336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181357.869258:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408383360:0@lo:400:kworker.0 00000100:00100000:3.0:1789181357.869283:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.871901:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408383232:12345-0@lo:400:kworker.0 Request processed in 2779us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181357.871915:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789181357.872006:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360e300 x1876092408383232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181357.872022:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408383232:0@lo:400:kworker.0 00000100:00100000:0.0:1789181357.872088:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408383360 00000100:00100000:0.0:1789181357.872095:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408383360 00000100:00100000:0.0:1789181357.872170:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789181357.872179:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408383360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181357.872491:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408383360:12345-0@lo:400:kworker.0 Request processed in 312us (3206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181357.872629:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1789181357.872755:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181357.872785:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408383360:0@lo:400:kworker.0 00000100:00100000:2.0:1789181357.887795:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408383488:0@lo:400:kworker.0 00000100:00100000:2.0:1789181357.887896:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.887960:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408383104:0@lo:400:kworker.0 00000100:00100000:2.0:1789181357.887987:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.890389:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408383488 00000100:00100000:0.0:1789181357.890407:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408383488 00000100:00100000:0.0:1789181357.890837:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789181357.890851:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408383488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181357.890974:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408383488:12345-0@lo:400:kworker.0 Request processed in 126us (3077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181357.890982:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789181357.892528:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408383104 00000100:00100000:3.0:1789181357.892543:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408383104 00000100:00100000:3.0:1789181357.892597:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789181357.892607:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408383104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181357.892679:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408383104:12345-0@lo:400:kworker.0 Request processed in 74us (4690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.892686:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789181357.898324:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789181357.898391:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360ed80 x1876092408383488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181357.898409:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408383488:0@lo:400:kworker.0 00010000:00080000:2.0:1789181357.898423:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360d500 x1876092408383104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181357.898432:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408383104:0@lo:400:kworker.0 00010000:00010000:3.0:1789181358.612607:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181359.628085:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181359.888277:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181359.888313:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408383616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789181359.888401:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181359.888956:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408383616 00000100:00100000:1.0:1789181359.888981:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408383616 00000100:00100000:1.0:1789181359.889039:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789181359.889049:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408383616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181359.889084:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181359.889187:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408383616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181359.889194:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789181359.890430:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408383616:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789181360.655079:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181361.424046:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408383744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181361.424157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181361.424234:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408383744 00000100:00100000:3.0:1789181361.424242:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408383744 00000100:00100000:3.0:1789181361.424298:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789181361.424307:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408383744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181361.424337:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181361.424376:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408383744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181361.424383:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1789181361.424419:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3975180 x1876092408383744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181361.424437:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408383744:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789181361.425172:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181361.425184:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181361.425195:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408383872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181361.425233:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181361.425305:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408383872 00000100:00100000:3.0:1789181361.425312:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408383872 00000100:00100000:3.0:1789181361.425351:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789181361.425358:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408383872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181361.425371:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181361.425402:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408383872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181361.425407:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789181361.425460:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789181361.425487:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3977800 x1876092408383872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181361.425504:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408383872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789181361.678003:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181362.027187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181362.027236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181362.027258:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181362.027298:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385241088 00000100:00100000:0.0:1789181362.027307:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385241088 00000100:00100000:2.0:1789181362.027397:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385241216 00000100:00100000:2.0:1789181362.027402:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385241216 00000100:00100000:2.0:1789181362.027448:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385241344 00000100:00100000:2.0:1789181362.027450:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385241344 00000100:00100000:2.0:1789181362.027471:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1789181362.027480:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385241216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181362.027553:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385241216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 68us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181362.027560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1789181362.027577:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:2.0:1789181362.027584:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385241344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181362.027615:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385241344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181362.027622:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00080000:2.0:1789181362.027637:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181362.027640:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181362.029164:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 287 00000100:00100000:0.0:1789181362.029178:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385241088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181362.029437:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385241088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 262us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181362.029445:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 287 00000100:00100000:2.0:1789181362.445435:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408384000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181362.445525:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181362.445909:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408384000 00000100:00100000:1.0:1789181362.445929:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408384000 00000100:00100000:1.0:1789181362.445981:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789181362.445991:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408384000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181362.446027:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789181362.446089:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408384000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181362.446096:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789181362.446173:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408384000:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789181362.705394:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181362.955940:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181362.955968:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408384128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181362.956043:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181362.956123:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408384128 00000100:00100000:3.0:1789181362.956131:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408384128 00000100:00100000:3.0:1789181362.956187:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789181362.956197:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408384128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181362.956227:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181362.956289:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408384128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181362.956297:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789181362.956319:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789181362.956585:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc2757100 x1876092408384128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181362.956604:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc2757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408384128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181362.957282:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408384640:0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.957324:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181362.957347:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408385152:0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.957369:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181362.957388:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789181362.957393:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408384512:0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.957415:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181362.957432:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408385024:0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.957452:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181362.957476:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408385536:0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.957496:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181362.957533:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408384512 00000100:00100000:1.0:1789181362.957538:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408384512 00000100:00100000:1.0:1789181362.957579:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789181362.957587:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408384512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.957630:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408384512:12345-0@lo:400:kworker.0 Request processed in 44us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181362.957638:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789181362.957671:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408384512:0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.957849:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408385152 00000100:00100000:1.0:1789181362.957854:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408385152 00000100:00100000:1.0:1789181362.957880:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408385024 00000100:00100000:1.0:1789181362.957883:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408385024 00000100:00100000:1.0:1789181362.957894:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408385536 00000100:00100000:1.0:1789181362.957896:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408385536 00000100:00100000:1.0:1789181362.957918:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789181362.957924:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408385152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.957962:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408385152:12345-0@lo:400:kworker.0 Request processed in 38us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181362.957968:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789181362.957981:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789181362.957987:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408385024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.958013:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408385024:12345-0@lo:400:kworker.0 Request processed in 26us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181362.958018:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789181362.958028:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789181362.958034:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408385536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.958057:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408385536:12345-0@lo:400:kworker.0 Request processed in 24us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181362.958070:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789181362.958096:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3895880 x1876092408385024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181362.958278:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408384256:0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.958313:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181362.958341:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408384768:0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.958362:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181362.958381:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408385280:0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.958401:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181362.958422:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789181362.958427:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408384384:0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.958447:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181362.958462:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408384896:0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.958480:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181362.958496:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408385408:0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.958515:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181362.958539:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408384640 00000100:00100000:3.0:1789181362.958543:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408384640 00000100:00100000:3.0:1789181362.958701:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789181362.958710:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408384640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.959202:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408385024:0@lo:400:kworker.0 00010000:00080000:1.0:1789181362.959227:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3894e00 x1876092408385536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181362.959302:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408385536:0@lo:400:kworker.0 00010000:00080000:1.0:1789181362.959319:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3895f80 x1876092408385152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181362.959329:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408385152:0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.959447:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408384640:12345-0@lo:400:kworker.0 Request processed in 738us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181362.959462:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789181362.959496:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181362.959511:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408384256 00000100:00100000:3.0:1789181362.959516:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408384256 00000100:00100000:3.0:1789181362.959550:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789181362.959557:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408384256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.959597:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408384256:12345-0@lo:400:kworker.0 Request processed in 41us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181362.959603:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789181362.959630:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408384768 00000100:00100000:3.0:1789181362.959634:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408384768 00000100:00100000:3.0:1789181362.959658:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408385280 00000100:00100000:3.0:1789181362.959661:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408385280 00000100:00100000:3.0:1789181362.959673:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408384384 00000100:00100000:3.0:1789181362.959675:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408384384 00000100:00100000:3.0:1789181362.959683:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408384896 00000100:00100000:3.0:1789181362.959685:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408384896 00000100:00100000:3.0:1789181362.959711:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408385408 00000100:00100000:3.0:1789181362.959714:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408385408 00000100:00100000:3.0:1789181362.959746:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789181362.959754:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408384768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.959785:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408384768:12345-0@lo:400:kworker.0 Request processed in 32us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181362.959791:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789181362.959802:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789181362.959807:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408385280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.959834:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408385280:12345-0@lo:400:kworker.0 Request processed in 27us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181362.959849:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789181362.959862:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789181362.959867:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408384384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.959895:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408384384:12345-0@lo:400:kworker.0 Request processed in 28us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181362.959901:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789181362.959912:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789181362.959917:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408384896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.959943:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408384896:12345-0@lo:400:kworker.0 Request processed in 26us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181362.959949:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789181362.959959:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789181362.959964:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408385408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.959991:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408385408:12345-0@lo:400:kworker.0 Request processed in 26us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181362.959996:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1789181362.960096:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181362.960100:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181362.960144:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408384384:0@lo:400:kworker.0 00010000:00080000:3.0:1789181362.960156:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3896d80 x1876092408384896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181362.960165:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408384896:0@lo:400:kworker.0 00010000:00080000:3.0:1789181362.960174:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3895c00 x1876092408385408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181362.960195:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408385408:0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.960207:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408384256:0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.960218:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408384768:0@lo:400:kworker.0 00000100:00100000:3.0:1789181362.960227:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408385280:0@lo:400:kworker.0 00000100:00100000:1.0:1789181362.961124:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408384640:0@lo:400:kworker.0 00000100:00100000:0.0:1789181362.966219:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408385664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181362.966291:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181362.966548:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408385664 00000100:00100000:1.0:1789181362.966558:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408385664 00000100:00100000:1.0:1789181362.966613:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789181362.966622:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408385664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181362.966648:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181362.966713:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408385664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181362.966721:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789181362.967086:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3894000 x1876092408385664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181362.967108:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408385664:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789181363.727590:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181364.755808:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181365.007226:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181365.007251:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408385792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181365.007326:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181365.010139:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408385792 00000100:00100000:2.0:1789181365.010155:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408385792 00000100:00100000:2.0:1789181365.010216:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789181365.010227:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408385792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789181365.010277:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789181365.010358:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408385792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (3032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181365.010365:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789181365.010424:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408385792:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789181365.777083:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181366.541697:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408385920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789181366.541824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181366.542152:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408386048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181366.542192:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181366.542236:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408385920 00000100:00100000:3.0:1789181366.542247:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408385920 00000100:00100000:3.0:1789181366.542304:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408386048 00000100:00100000:3.0:1789181366.542308:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408386048 00000100:00100000:3.0:1789181366.542327:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789181366.542337:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408385920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181366.542373:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181366.542432:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408385920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181366.542439:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789181366.542457:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789181366.542462:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408386048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181366.542473:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181366.542512:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408386048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181366.542518:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789181366.542536:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181366.542568:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc255b480 x1876092408386048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181366.542590:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408386048:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789181366.542848:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3975880 x1876092408385920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181366.542865:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408385920:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789181366.804122:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181367.142183:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181367.142220:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181367.142249:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181367.142290:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385241600 00000100:00100000:3.0:1789181367.142301:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385241600 00000100:00100000:3.0:1789181367.142361:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385241728 00000100:00100000:3.0:1789181367.142365:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385241728 00000100:00100000:3.0:1789181367.142389:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:3.0:1789181367.142401:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385241600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181367.142493:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385241600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 94us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181367.142514:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:3.0:1789181367.142532:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:3.0:1789181367.142539:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385241728:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181367.142968:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385241728:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 428us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181367.142975:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00080000:3.0:1789181367.142998:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181367.143002:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181367.143479:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385241472 00000100:00100000:2.0:1789181367.143486:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385241472 00000100:00100000:2.0:1789181367.143536:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 289 00000100:00100000:2.0:1789181367.143763:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385241472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181367.143816:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+10:2394:x1876092385241472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 271us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181367.143824:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 289 00000100:00100000:0.0:1789181367.564206:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408386176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181367.564292:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181367.564455:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408386176 00000100:00100000:1.0:1789181367.564463:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408386176 00000100:00100000:1.0:1789181367.564522:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789181367.564532:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408386176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181367.564584:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789181367.564641:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408386176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181367.564657:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789181367.564919:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408386176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789181367.822225:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181368.076436:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181368.076478:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408386304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181368.076559:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181368.076627:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408386304 00000100:00100000:3.0:1789181368.076637:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408386304 00000100:00100000:3.0:1789181368.076709:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789181368.076720:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408386304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181368.076792:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181368.076837:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408386304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181368.076844:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1789181368.076865:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789181368.076897:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3208700 x1876092408386304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181368.076918:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408386304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181368.078222:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408386688:0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.078274:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181368.078305:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408387200:0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.078339:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181368.078364:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408387712:0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.078384:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181368.078404:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789181368.078410:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408386560:0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.078436:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181368.078478:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408387072:0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.078527:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181368.078550:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408387584:0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.078574:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181368.078605:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408386560 00000100:00100000:1.0:1789181368.078612:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408386560 00000100:00100000:1.0:1789181368.078667:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789181368.078677:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408386560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.078754:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408386560:12345-0@lo:400:kworker.0 Request processed in 78us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181368.078762:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789181368.078809:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408387072 00000100:00100000:1.0:1789181368.078819:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408387072 00000100:00100000:1.0:1789181368.078846:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789181368.078853:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408387072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.078890:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408387072:12345-0@lo:400:kworker.0 Request processed in 38us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181368.078896:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789181368.078915:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408387584 00000100:00100000:1.0:1789181368.078918:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408387584 00000100:00100000:1.0:1789181368.078948:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789181368.078954:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408387584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.078986:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408387584:12345-0@lo:400:kworker.0 Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181368.078992:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789181368.079150:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408386560:0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.079162:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408387072:0@lo:400:kworker.0 00010000:00080000:1.0:1789181368.079173:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3897b80 x1876092408387584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181368.079184:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408387584:0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.080878:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408386688 00000100:00100000:3.0:1789181368.080897:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408386688 00000100:00100000:3.0:1789181368.080959:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408387200 00000100:00100000:3.0:1789181368.080963:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408387200 00000100:00100000:3.0:1789181368.080981:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408387712 00000100:00100000:3.0:1789181368.080984:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408387712 00000100:00100000:3.0:1789181368.081006:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789181368.081015:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408386688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.081113:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408386688:12345-0@lo:400:kworker.0 Request processed in 98us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181368.081121:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789181368.081139:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789181368.081161:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408387200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.081193:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408387200:12345-0@lo:400:kworker.0 Request processed in 33us (2865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181368.081198:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789181368.081209:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789181368.081215:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408387712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.081242:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408387712:12345-0@lo:400:kworker.0 Request processed in 28us (2857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181368.081248:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1789181368.081281:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181368.081286:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181368.081304:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408386432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181368.081356:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181368.081384:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408386944:0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.081418:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181368.081438:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408387456:0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.081889:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181368.081919:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408387968:0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.081952:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181368.081984:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789181368.082001:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408386816:0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.082036:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181368.082064:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408387328:0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.082097:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181368.082120:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408387840:0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.082161:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181368.082213:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408387456 00000100:00100000:3.0:1789181368.082220:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408387456 00000100:00100000:3.0:1789181368.082273:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408387968 00000100:00100000:3.0:1789181368.082276:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408387968 00000100:00100000:3.0:1789181368.082302:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789181368.082309:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408387456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.082679:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408387456:12345-0@lo:400:kworker.0 Request processed in 370us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181368.082688:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789181368.082713:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789181368.082752:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408387968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.085635:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408387968:12345-0@lo:400:kworker.0 Request processed in 2906us (3672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181368.085661:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789181368.085775:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408386944 00000100:00100000:1.0:1789181368.085785:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408386944 00000100:00100000:1.0:1789181368.085818:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408387328 00000100:00100000:1.0:1789181368.085822:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408387328 00000100:00100000:1.0:1789181368.085840:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408387840 00000100:00100000:1.0:1789181368.085843:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408387840 00000100:00100000:1.0:1789181368.085859:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789181368.085868:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408386944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.085929:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408386944:12345-0@lo:400:kworker.0 Request processed in 62us (4509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181368.085936:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789181368.085951:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789181368.085958:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408387328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.085987:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408387328:12345-0@lo:400:kworker.0 Request processed in 30us (3889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181368.085994:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789181368.086005:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789181368.086012:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408387840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181368.086040:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408387840:12345-0@lo:400:kworker.0 Request processed in 28us (3878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181368.086045:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789181368.088095:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408386816 00000100:00100000:0.0:1789181368.088114:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408386816 00000100:00100000:0.0:1789181368.088167:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789181368.088178:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408386816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181368.088269:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408386816:12345-0@lo:400:kworker.0 Request processed in 92us (6231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181368.088277:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789181368.088309:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408386432 00000100:00100000:0.0:1789181368.088313:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408386432 00000100:00080000:2.0:1789181368.088781:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181368.088789:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181368.088792:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181368.089970:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789181368.089989:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408386432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181368.090017:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181368.090093:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408386432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (8736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181368.090100:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789181368.090161:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408386688:0@lo:400:kworker.0 00000100:00100000:0.0:1789181368.090178:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408387200:0@lo:400:kworker.0 00000100:00100000:0.0:1789181368.090190:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408387712:0@lo:400:kworker.0 00000100:00100000:3.0:1789181368.091952:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408386816:0@lo:400:kworker.0 00010000:00080000:3.0:1789181368.091973:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3895f80 x1876092408387328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181368.091985:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408387328:0@lo:400:kworker.0 00010000:00080000:3.0:1789181368.091998:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3895c00 x1876092408387840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181368.092007:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408387840:0@lo:400:kworker.0 00010000:00080000:3.0:1789181368.092020:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3894e00 x1876092408386432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181368.092038:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408386432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181368.092069:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408386944:0@lo:400:kworker.0 00010000:00080000:3.0:1789181368.092081:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3894000 x1876092408387456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181368.092089:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408387456:0@lo:400:kworker.0 00010000:00080000:3.0:1789181368.092100:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3896d80 x1876092408387968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181368.092108:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408387968:0@lo:400:kworker.0 00010000:00010000:2.0:1789181368.844289:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181369.869913:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181370.124033:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408388096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181370.124669:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181370.132538:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408388096 00000100:00100000:1.0:1789181370.132552:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408388096 00000100:00100000:1.0:1789181370.132618:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789181370.132637:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408388096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181370.132711:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181370.132835:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408388096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 208us (8170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181370.132843:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789181370.133082:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408388096:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789181370.896004:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789181371.141221:0:11996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:49:29 (1789181369) === 00000100:00100000:2.0:1789181371.555942:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181371.556063:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385241856 00000100:00100000:3.0:1789181371.556074:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385241856 00000100:00100000:3.0:1789181371.556136:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:3.0:1789181371.556147:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+10:8728:x1876092385241856:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789181371.556164:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181371.556184:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085e400/0x76fb5552835170ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7df5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181371.556229:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085e400/0x76fb5552835170ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7df5 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181371.556252:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085e400/0x76fb5552835170ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7df5 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181371.556317:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e400, rc 0) 00000100:00100000:3.0:1789181371.556638:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+11:8728:x1876092385241856:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 492us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181371.556647:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 291 00000100:00100000:2.0:1789181371.564905:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181371.565014:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385241984 00000100:00100000:1.0:1789181371.565025:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385241984 00000100:00100000:1.0:1789181371.565087:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 292 00000100:00100000:1.0:1789181371.565098:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+11:8728:x1876092385241984:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789181371.565311:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+11:8728:x1876092385241984:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 214us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181371.565319:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 292 00000100:00100000:2.0:1789181371.574748:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181371.575026:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385242112 00000100:00100000:3.0:1789181371.575036:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385242112 00000100:00100000:3.0:1789181371.575105:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 293 00000100:00100000:3.0:1789181371.575118:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+11:8728:x1876092385242112:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789181371.575310:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+11:8728:x1876092385242112:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 195us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181371.575319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 293 00000100:00100000:2.0:1789181371.580336:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181371.582141:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385242240 00000100:00100000:0.0:1789181371.582159:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385242240 00000100:00100000:0.0:1789181371.582284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 294 00000100:00100000:0.0:1789181371.582296:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+11:8732:x1876092385242240:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181371.582561:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+11:8732:x1876092385242240:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 266us (2235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.582570:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 294 00000100:00100000:2.0:1789181371.610083:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181371.610192:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385242368 00000100:00100000:1.0:1789181371.610203:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385242368 00000100:00100000:1.0:1789181371.610266:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 295 00000100:00100000:1.0:1789181371.610277:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+11:8732:x1876092385242368:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181371.610443:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+11:8732:x1876092385242368:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 166us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181371.610450:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 295 00000100:00100000:2.0:1789181371.612587:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181371.612691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385242496 00000100:00100000:3.0:1789181371.612702:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385242496 00000100:00100000:0.0:1789181371.614077:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 296 00000100:00100000:0.0:1789181371.614094:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+11:8732:x1876092385242496:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181371.614290:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+11:8732:x1876092385242496:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 200us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.614298:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 296 00000100:00100000:2.0:1789181371.629530:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181371.629686:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385242624 00000100:00100000:1.0:1789181371.629698:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385242624 00000100:00100000:1.0:1789181371.629804:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 297 00000100:00100000:1.0:1789181371.629816:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+11:8728:x1876092385242624:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789181371.629834:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181371.629854:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e021f0c00/0x76fb5552835170b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181371.629887:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e021f0c00/0x76fb5552835170b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e26 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181371.629899:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e021f0c00/0x76fb5552835170b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e26 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181371.629909:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e021f0c00, rc 0) 00000100:00100000:1.0:1789181371.629969:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+12:8728:x1876092385242624:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 155us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181371.629988:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 297 00000100:00100000:0.0:1789181371.634053:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181371.634171:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385242752 00000100:00100000:2.0:1789181371.634183:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385242752 00000100:00100000:0.0:1789181371.634313:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 298 00000100:00100000:0.0:1789181371.634325:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+12:8728:x1876092385242752:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789181371.634355:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789181371.634427:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789181371.634433:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789181371.634437:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789181371.634440:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789181371.634443:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789181371.637963:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+12:8728:x1876092385242752:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 3628us (3907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.637982:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 298 00000100:00100000:2.0:1789181371.640993:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181371.641211:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385242880 00000100:00100000:0.0:1789181371.641222:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385242880 00000100:00100000:0.0:1789181371.641279:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 299 00000100:00100000:0.0:1789181371.641291:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+12:8728:x1876092385242880:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789181371.641325:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181371.641345:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658ac00/0x76fb5552835170ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181371.641388:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658ac00/0x76fb5552835170ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e2d expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181371.641400:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658ac00/0x76fb5552835170ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e2d expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181371.641409:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658ac00, rc 0) 00000100:00100000:0.0:1789181371.641707:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:8728:x1876092385242880:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 417us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.641766:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 299 00000100:00100000:2.0:1789181371.644940:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181371.645050:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385243008 00000100:00100000:0.0:1789181371.645061:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385243008 00000100:00100000:0.0:1789181371.645155:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 300 00000100:00100000:0.0:1789181371.645166:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:8728:x1876092385243008:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789181371.645317:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:8728:x1876092385243008:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 152us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.645324:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 300 00000100:00100000:3.0:1789181371.647105:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181371.649077:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385243136 00000100:00100000:1.0:1789181371.649093:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385243136 00000100:00100000:1.0:1789181371.649149:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:1.0:1789181371.649160:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:8728:x1876092385243136:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789181371.649386:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:8728:x1876092385243136:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 226us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181371.649396:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 301 00000100:00100000:3.0:1789181371.652847:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181371.653013:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385243264 00000100:00100000:0.0:1789181371.653025:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385243264 00000100:00100000:0.0:1789181371.653080:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 302 00000100:00100000:0.0:1789181371.653091:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:8735:x1876092385243264:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181371.654317:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:8735:x1876092385243264:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 1220us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.654339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 302 00000100:00100000:3.0:1789181371.666227:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181371.666520:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385243392 00000100:00100000:1.0:1789181371.666531:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385243392 00000100:00100000:1.0:1789181371.666602:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 303 00000100:00100000:1.0:1789181371.666625:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:8735:x1876092385243392:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181371.666846:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:8735:x1876092385243392:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 223us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181371.666855:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 303 00000100:00100000:3.0:1789181371.667121:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408388224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181371.667171:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181371.667314:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408388224 00000100:00100000:0.0:1789181371.667321:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408388224 00000100:00100000:0.0:1789181371.667380:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789181371.667390:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408388224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181371.667457:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181371.667510:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408388224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.667517:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789181371.667643:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181371.667678:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc35f8700 x1876092408388224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181371.667699:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408388224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181371.669129:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181371.669146:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408388352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181371.669213:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181371.669310:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408388352 00000100:00100000:0.0:1789181371.669317:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408388352 00000100:00100000:0.0:1789181371.669387:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789181371.669397:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408388352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181371.669419:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181371.669480:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408388352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.669487:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1789181371.669525:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc35faa00 x1876092408388352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181371.669542:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408388352:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789181371.669705:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181371.677875:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181371.677918:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181371.677935:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181371.677974:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181371.678054:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385243520 00000100:00100000:2.0:1789181371.678066:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385243520 00000100:00100000:2.0:1789181371.678104:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385243776 00000100:00100000:2.0:1789181371.678107:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385243776 00000100:00100000:2.0:1789181371.678115:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385244160 00000100:00100000:2.0:1789181371.678118:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385244160 00000100:00100000:2.0:1789181371.678166:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385244288 00000100:00100000:2.0:1789181371.678169:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385244288 00000100:00100000:2.0:1789181371.678189:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1789181371.678200:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2396:x1876092385244160:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181371.678282:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2396:x1876092385244160:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181371.678291:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1789181371.678308:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:2.0:1789181371.678314:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2396:x1876092385244288:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181371.678339:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2396:x1876092385244288:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181371.678345:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:2.0:1789181371.678356:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1789181371.678360:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876092385243520:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789181371.678415:0:9021:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d0e89ea0-dcb5-49cb-8994-643fecfb5dac@192.168.202.1@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1789181371.678455:0:9021:0:(genops.c:1384:class_connect()) connect: client d0e89ea0-dcb5-49cb-8994-643fecfb5dac, cookie 0x76fb5552835170c1 00000004:00100000:2.0:1789181371.678495:0:9021:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789181371.678639:0:9021:0:(import.c:65:import_set_state_nolock()) ffff9c1cc38d2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181371.678671:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2392:x1876092385243520:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 309us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181371.678679:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1789181371.678694:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1789181371.678698:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876092385243776:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789181371.678713:0:9021:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from d0e89ea0-dcb5-49cb-8994-643fecfb5dac@192.168.202.1@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1789181371.678776:0:9021:0:(genops.c:1384:class_connect()) connect: client d0e89ea0-dcb5-49cb-8994-643fecfb5dac, cookie 0x76fb5552835170c8 00000004:00100000:2.0:1789181371.678787:0:9021:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789181371.678836:0:9021:0:(import.c:65:import_set_state_nolock()) ffff9c1cc38d2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181371.678857:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2392:x1876092385243776:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 158us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181371.678863:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00080000:1.0:1789181371.680586:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181371.680596:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181371.686797:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181371.686834:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181371.686888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181371.686971:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385243904 00000100:00100000:0.0:1789181371.686981:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385243904 00000100:00100000:0.0:1789181371.687051:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385243648 00000100:00100000:0.0:1789181371.687054:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385243648 00000100:00100000:0.0:1789181371.687066:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385244032 00000100:00100000:0.0:1789181371.687068:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385244032 00000100:00100000:0.0:1789181371.687096:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1789181371.687105:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:0:x1876092385243904:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789181371.687146:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789181371.687275:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:0:x1876092385243904:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 171us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.687283:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1789181371.687305:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1789181371.687312:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+7:0:x1876092385243648:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789181371.687331:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789181371.687404:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+7:0:x1876092385243648:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 92us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.687410:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1789181371.687424:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1789181371.687431:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:8728:x1876092385244032:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789181371.687442:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789181371.687463:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:8728:x1876092385244032:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 33us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.687470:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00080000:1.0:1789181371.688099:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181371.688104:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181371.700094:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181371.700320:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385244416 00000100:00100000:0.0:1789181371.700332:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385244416 00000100:00100000:0.0:1789181371.700403:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1789181371.700415:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:8728:x1876092385244416:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789181371.700913:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:8728:x1876092385244416:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 497us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181371.700939:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1789181371.705034:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181371.705116:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181371.705198:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181371.705234:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385244800 00000100:00100000:3.0:1789181371.705246:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385244800 00000100:00100000:3.0:1789181371.705314:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1789181371.705328:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:8728:x1876092385244800:12345-192.168.202.1@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789181371.705431:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:8728:x1876092385244800:12345-192.168.202.1@tcp:900:mount.lustre.0 Request processed in 106us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181371.705440:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1789181371.708577:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181371.709050:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385244928 00000100:00100000:2.0:1789181371.709063:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385244928 00000100:00100000:2.0:1789181371.709127:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1789181371.709139:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:8728:x1876092385244928:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789181371.709233:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789181371.709324:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:8728:x1876092385244928:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 186us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181371.709332:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1789181371.709659:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385244544 00000100:00100000:1.0:1789181371.709666:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385244544 00000100:00100000:1.0:1789181371.709694:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385244672 00000100:00100000:1.0:1789181371.709697:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385244672 00000100:00100000:2.0:1789181371.709857:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1789181371.709865:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1876092385244544:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789181371.709896:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d0e89ea0-dcb5-49cb-8994-643fecfb5dac@192.168.202.1@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1789181371.709932:0:8436:0:(genops.c:1384:class_connect()) connect: client d0e89ea0-dcb5-49cb-8994-643fecfb5dac, cookie 0x76fb5552835170cf 00002000:00100000:2.0:1789181371.709945:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d0e89ea0-dcb5-49cb-8994-643fecfb5dac/ffff9c1cc38d1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789181371.709958:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789181371.710037:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789181371.710069:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c1cc38d6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181371.710105:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2392:x1876092385244544:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 240us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181371.710113:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1789181371.710128:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1789181371.710133:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1876092385244672:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789181371.710149:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d0e89ea0-dcb5-49cb-8994-643fecfb5dac@192.168.202.1@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1789181371.710167:0:8436:0:(genops.c:1384:class_connect()) connect: client d0e89ea0-dcb5-49cb-8994-643fecfb5dac, cookie 0x76fb5552835170d6 00002000:00100000:2.0:1789181371.710173:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d0e89ea0-dcb5-49cb-8994-643fecfb5dac/ffff9c1cc38d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789181371.710185:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789181371.710221:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789181371.710235:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c1cc38d3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181371.710259:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2392:x1876092385244672:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 123us (5060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181371.710266:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00010000:00010000:0.0:1789181371.926407:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181372.684191:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408388480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181372.684272:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181372.684499:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408388480 00000100:00100000:1.0:1789181372.684508:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408388480 00000100:00100000:1.0:1789181372.684595:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789181372.684614:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc66d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408388480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181372.684653:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789181372.684717:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc66d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408388480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181372.684750:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789181372.685305:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408388480:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789181372.961434:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181373.195938:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181373.195964:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408388608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181373.196037:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181373.196105:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408388608 00000100:00100000:3.0:1789181373.196115:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408388608 00000100:00100000:3.0:1789181373.196175:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789181373.196185:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408388608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181373.196216:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181373.196258:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408388608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181373.196263:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789181373.196283:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789181373.196313:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb57c700 x1876092408388608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181373.196331:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408388608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181373.196942:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408388992:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.196984:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.197005:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408389504:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197025:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.197044:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408390016:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197063:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.197082:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789181373.197088:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408388864:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197115:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.197138:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408389376:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197198:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.197215:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408389888:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197236:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.197266:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408388992 00000100:00100000:0.0:1789181373.197271:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408388992 00000100:00100000:0.0:1789181373.197321:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408389504 00000100:00100000:0.0:1789181373.197325:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408389504 00000100:00100000:0.0:1789181373.197343:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408390016 00000100:00100000:0.0:1789181373.197346:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408390016 00000100:00100000:0.0:1789181373.197374:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789181373.197382:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408388992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197426:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408388992:12345-0@lo:400:kworker.0 Request processed in 46us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.197433:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789181373.197449:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789181373.197454:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408389504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197481:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408389504:12345-0@lo:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.197486:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789181373.197496:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789181373.197502:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408390016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197526:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408390016:12345-0@lo:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.197531:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789181373.197553:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408388864 00000100:00100000:0.0:1789181373.197556:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408388864 00000100:00100000:0.0:1789181373.197580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789181373.197585:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408388864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197626:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408388864:12345-0@lo:400:kworker.0 Request processed in 40us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.197632:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789181373.197661:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408389376 00000100:00100000:0.0:1789181373.197671:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408389376 00000100:00100000:0.0:1789181373.197697:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789181373.197703:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408389376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197774:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408389376:12345-0@lo:400:kworker.0 Request processed in 71us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.197780:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789181373.197799:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408389888 00000100:00100000:0.0:1789181373.197803:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408389888 00000100:00100000:0.0:1789181373.197830:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789181373.197836:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408389888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197866:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408389888:12345-0@lo:400:kworker.0 Request processed in 31us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.197872:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789181373.197904:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408389120:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197929:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.197946:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408389632:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.197965:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.197981:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408390144:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198001:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.198017:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789181373.198023:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408388736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181373.198044:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.198059:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408389248:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198075:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.198090:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408389760:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198121:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.198139:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408390272:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198156:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181373.198180:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408389120 00000100:00100000:0.0:1789181373.198184:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408389120 00000100:00100000:0.0:1789181373.198205:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789181373.198211:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408389120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198247:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408389120:12345-0@lo:400:kworker.0 Request processed in 36us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.198252:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789181373.198285:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408389760 00000100:00100000:0.0:1789181373.198289:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408389760 00000100:00100000:0.0:1789181373.198310:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408390272 00000100:00100000:0.0:1789181373.198314:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408390272 00000100:00100000:0.0:1789181373.198330:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789181373.198335:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408389760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198363:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408389760:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.198369:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789181373.198380:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789181373.198385:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408390272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198409:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408390272:12345-0@lo:400:kworker.0 Request processed in 24us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.198415:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789181373.198432:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408389632 00000100:00100000:0.0:1789181373.198435:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408389632 00000100:00100000:0.0:1789181373.198448:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408390144 00000100:00100000:0.0:1789181373.198456:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408390144 00000100:00100000:0.0:1789181373.198472:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408389248 00000100:00100000:0.0:1789181373.198474:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408389248 00000100:00100000:0.0:1789181373.198483:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789181373.198489:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408389632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198516:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408389632:12345-0@lo:400:kworker.0 Request processed in 28us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.198521:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789181373.198530:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789181373.198535:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408390144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198560:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408390144:12345-0@lo:400:kworker.0 Request processed in 25us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.198565:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789181373.198575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789181373.198581:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408389248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198615:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408389248:12345-0@lo:400:kworker.0 Request processed in 34us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181373.198619:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789181373.198654:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408389248:0@lo:400:kworker.0 00010000:00080000:0.0:1789181373.198665:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3a02a00 x1876092408389760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181373.198675:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408389760:0@lo:400:kworker.0 00010000:00080000:0.0:1789181373.198683:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc437a680 x1876092408390272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181373.198690:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408390272:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198706:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408389120:0@lo:400:kworker.0 00010000:00080000:0.0:1789181373.198714:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3a00a80 x1876092408389632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181373.198738:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408389632:0@lo:400:kworker.0 00010000:00080000:0.0:1789181373.198747:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c6300 x1876092408390144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181373.198755:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408390144:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198787:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408388864:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198796:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408389376:0@lo:400:kworker.0 00010000:00080000:0.0:1789181373.198805:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3a02680 x1876092408389888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181373.198813:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408389888:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198821:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408388992:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198830:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408389504:0@lo:400:kworker.0 00000100:00100000:0.0:1789181373.198839:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408390016:0@lo:400:kworker.0 00000100:00080000:3.0:1789181373.200566:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181373.200577:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181373.200614:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181373.200616:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181373.200634:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408388736 00000100:00100000:3.0:1789181373.200645:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408388736 00000100:00100000:3.0:1789181373.200702:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789181373.200712:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408388736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181373.200773:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181373.200847:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408388736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181373.200853:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1789181373.207155:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3a00380 x1876092408388736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181373.207190:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408388736:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789181373.963912:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181374.988092:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181375.272454:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408390400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181375.272533:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181375.272840:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408390400 00000100:00100000:1.0:1789181375.272850:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408390400 00000100:00100000:1.0:1789181375.272907:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789181375.272917:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408390400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181375.272953:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181375.273012:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408390400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.273019:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789181375.273134:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408390400:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789181376.012070:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181376.780635:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181376.780659:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408390528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181376.780755:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181376.780814:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408390656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181376.780838:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181376.780879:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408390528 00000100:00100000:0.0:1789181376.780890:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408390528 00000100:00100000:0.0:1789181376.780937:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408390656 00000100:00100000:0.0:1789181376.780941:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408390656 00000100:00100000:0.0:1789181376.781156:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789181376.781166:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408390528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181376.781199:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181376.781250:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408390528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181376.781257:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789181376.781273:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789181376.781278:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408390656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181376.781287:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181376.781311:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408390656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181376.781316:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789181376.784851:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181376.784946:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093ce00 x1876092408390656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181376.785596:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408390656:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789181376.786587:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093f480 x1876092408390528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181376.786761:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408390528:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789181376.798480:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000001:00100000:1.0:1789181376.801443:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000100:00100000:2.0:1789181376.872153:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181376.872202:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181376.872239:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181376.872354:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385245056 00000100:00100000:0.0:1789181376.872365:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385245056 00000100:00100000:0.0:1789181376.872420:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 305 00000100:00100000:0.0:1789181376.872430:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385245056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181376.872503:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385245056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181376.872511:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 305 00000100:00100000:2.0:1789181376.872995:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181376.873014:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181376.873055:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385245824 00000100:00100000:0.0:1789181376.873060:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385245824 00000100:00100000:0.0:1789181376.873101:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1789181376.873109:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2393:x1876092385245824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181376.873149:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2393:x1876092385245824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181376.873156:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00080000:0.0:1789181376.873176:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181376.893250:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181376.898219:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385245312 00000100:00100000:1.0:1789181376.898235:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385245312 00000100:00080000:1.0:1789181376.898317:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789181376.898382:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385245568 00000100:00100000:1.0:1789181376.898386:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385245568 00000100:00100000:1.0:1789181376.898410:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385245184 00000100:00100000:1.0:1789181376.898413:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385245184 00000100:00100000:1.0:1789181376.898453:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:1.0:1789181376.898464:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385245312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181376.898806:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385245312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 342us (26601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181376.898814:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:1.0:1789181376.898832:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:1.0:1789181376.898838:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385245568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181376.898858:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385245568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (26618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181376.898864:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:1.0:1789181376.898872:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:1.0:1789181376.898878:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385245184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181376.898894:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385245184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 17us (25880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181376.898900:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00080000:1.0:1789181376.898911:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181376.898913:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181376.900359:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181376.900401:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385245440 00000100:00100000:2.0:1789181376.900410:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385245440 00000100:00080000:2.0:1789181376.900434:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181376.900464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:2.0:1789181376.900484:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385245440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181376.900538:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385245440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 66us (7298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181376.900544:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:3.0:1789181376.900924:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385245696 00000100:00100000:3.0:1789181376.900930:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385245696 00000100:00100000:3.0:1789181376.900979:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1789181376.900986:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2393:x1876092385245696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181376.901021:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2393:x1876092385245696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181376.901027:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00080000:2.0:1789181376.901100:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789181377.036743:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181377.806342:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181377.806363:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408390784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181377.806432:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181377.806507:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408390784 00000100:00100000:1.0:1789181377.806514:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408390784 00000100:00100000:1.0:1789181377.806570:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789181377.806580:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408390784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181377.806614:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789181377.806677:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408390784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181377.806684:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789181377.806761:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408390784:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1789181377.829808:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000001:00100000:0.0:1789181377.829920:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00010000:00010000:0.0:1789181378.060014:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789181378.228164:0:12189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1789181378.315928:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408390912:0@lo:400:kworker.0 00000100:00100000:1.0:1789181378.315979:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408391168:0@lo:400:kworker.0 00000100:00100000:0.0:1789181378.315997:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181378.316010:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181378.316391:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408391680:0@lo:400:kworker.0 00000100:00100000:1.0:1789181378.316431:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181378.316463:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408392192:0@lo:400:kworker.0 00000100:00100000:1.0:1789181378.316489:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181378.316513:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789181378.316519:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408391296:0@lo:400:kworker.0 00000100:00100000:1.0:1789181378.316539:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181378.316568:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408391808:0@lo:400:kworker.0 00000100:00100000:1.0:1789181378.316591:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181378.316606:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408392320:0@lo:400:kworker.0 00000100:00100000:1.0:1789181378.316624:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181378.316656:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408391168 00000100:00100000:1.0:1789181378.316664:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408391168 00000100:00100000:1.0:1789181378.316705:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789181378.316714:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408391168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181378.316792:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408391168:12345-0@lo:400:kworker.0 Request processed in 78us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181378.316799:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789181378.316877:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408391040:0@lo:400:kworker.0 00000100:00100000:2.0:1789181378.316906:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181378.316925:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408391552:0@lo:400:kworker.0 00000100:00100000:2.0:1789181378.316945:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181378.316955:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408392064:0@lo:400:kworker.0 00000100:00100000:2.0:1789181378.316972:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181378.316983:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408392576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181378.317005:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181378.317034:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789181378.317040:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408391424:0@lo:400:kworker.0 00000100:00100000:2.0:1789181378.317060:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181378.317080:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408391936:0@lo:400:kworker.0 00000100:00100000:2.0:1789181378.317097:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181378.317111:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408392448:0@lo:400:kworker.0 00000100:00100000:2.0:1789181378.317127:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181378.317513:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408391680 00000100:00100000:3.0:1789181378.317519:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408391680 00000100:00100000:3.0:1789181378.317572:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408392192 00000100:00100000:3.0:1789181378.317576:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408392192 00000100:00100000:3.0:1789181378.317588:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408391296 00000100:00100000:3.0:1789181378.317590:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408391296 00000100:00100000:3.0:1789181378.317601:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408391040 00000100:00100000:3.0:1789181378.317603:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408391040 00000100:00100000:3.0:1789181378.317622:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408391552 00000100:00100000:3.0:1789181378.317625:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408391552 00000100:00100000:3.0:1789181378.317637:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408392064 00000100:00100000:3.0:1789181378.317639:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408392064 00000100:00100000:3.0:1789181378.317652:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789181378.317659:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408391680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.317702:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408391680:12345-0@lo:400:kworker.0 Request processed in 44us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181378.317709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789181378.317721:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789181378.317743:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408392192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.317772:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408392192:12345-0@lo:400:kworker.0 Request processed in 31us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181378.317777:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789181378.317788:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789181378.317793:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408391296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.317817:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408391296:12345-0@lo:400:kworker.0 Request processed in 24us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181378.317822:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789181378.317832:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789181378.317837:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408391040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.317869:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408391040:12345-0@lo:400:kworker.0 Request processed in 32us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181378.317875:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789181378.317885:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789181378.317891:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408391552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.317929:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408391552:12345-0@lo:400:kworker.0 Request processed in 38us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181378.317935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789181378.317946:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789181378.317950:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408392064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.317975:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408392064:12345-0@lo:400:kworker.0 Request processed in 24us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181378.317980:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789181378.317998:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408391808 00000100:00100000:3.0:1789181378.318001:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408391808 00000100:00100000:3.0:1789181378.318022:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408392320 00000100:00100000:3.0:1789181378.318025:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408392320 00000100:00100000:3.0:1789181378.318036:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408391936 00000100:00100000:3.0:1789181378.318039:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408391936 00000100:00100000:3.0:1789181378.318049:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408392448 00000100:00100000:3.0:1789181378.318051:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408392448 00000100:00100000:3.0:1789181378.318063:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789181378.318069:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408391808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.318098:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408391808:12345-0@lo:400:kworker.0 Request processed in 29us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181378.318104:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789181378.318113:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789181378.318119:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408392320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.318144:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408392320:12345-0@lo:400:kworker.0 Request processed in 25us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181378.318149:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789181378.318160:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181378.318185:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408391936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.318216:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408391936:12345-0@lo:400:kworker.0 Request processed in 45us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181378.318222:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181378.318232:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789181378.318239:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3971f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408392448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.318262:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3971f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408392448:12345-0@lo:400:kworker.0 Request processed in 24us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181378.318268:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1789181378.318306:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4302d80 x1876092408391936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181378.318329:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408391936:0@lo:400:kworker.0 00010000:00080000:3.0:1789181378.318341:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4303b80 x1876092408392448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181378.318349:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408392448:0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.318357:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408391040:0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.318365:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408391552:0@lo:400:kworker.0 00000100:00100000:3.0:1789181378.318372:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408392064:0@lo:400:kworker.0 00000100:00100000:1.0:1789181378.318990:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408391424 00000100:00100000:1.0:1789181378.318997:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408391424 00000100:00100000:1.0:1789181378.319033:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789181378.319040:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408391424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181378.319092:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408391424:12345-0@lo:400:kworker.0 Request processed in 52us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181378.319098:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789181378.319141:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408391296:0@lo:400:kworker.0 00010000:00080000:1.0:1789181378.319154:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4300700 x1876092408391808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181378.319164:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408391808:0@lo:400:kworker.0 00010000:00080000:1.0:1789181378.319189:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4302680 x1876092408392320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181378.319197:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408392320:0@lo:400:kworker.0 00000100:00100000:1.0:1789181378.319207:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408391168:0@lo:400:kworker.0 00010000:00080000:1.0:1789181378.319216:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc437a680 x1876092408391680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181378.319223:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408391680:0@lo:400:kworker.0 00010000:00080000:1.0:1789181378.319233:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4302300 x1876092408392192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181378.319240:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408392192:0@lo:400:kworker.0 00000100:00080000:2.0:1789181378.319360:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181378.319366:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181378.319368:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181378.319371:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181378.320222:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408391424:0@lo:400:kworker.0 00000100:00100000:0.0:1789181378.322115:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408390912 00000100:00100000:0.0:1789181378.322128:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408390912 00000100:00100000:0.0:1789181378.322180:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789181378.322190:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408390912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181378.322286:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408390912:12345-0@lo:400:kworker.0 Request processed in 98us (6288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181378.322307:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789181378.322365:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408392576 00000100:00100000:0.0:1789181378.322369:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408392576 00000100:00100000:0.0:1789181378.322394:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789181378.322400:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408392576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181378.322424:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181378.322465:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408392576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (5459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181378.322470:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789181378.322675:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408390912:0@lo:400:kworker.0 00010000:00080000:3.0:1789181378.323348:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb57d500 x1876092408392576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181378.323385:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408392576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181378.324809:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408392704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181378.324881:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181378.325165:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408392704 00000100:00100000:0.0:1789181378.325176:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408392704 00000100:00100000:0.0:1789181378.325237:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789181378.325249:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408392704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181378.325276:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181378.326240:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408392704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 989us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181378.326250:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1789181378.329099:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd136c000 x1876092408392704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181378.329130:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408392704:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789181379.084173:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181380.110758:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181380.363990:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408392832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181380.364069:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181380.364184:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408392832 00000100:00100000:1.0:1789181380.364193:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408392832 00000100:00100000:1.0:1789181380.364243:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789181380.364265:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408392832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181380.364302:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181380.364379:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408392832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181380.364385:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789181380.364478:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408392832:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789181381.132026:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181381.900478:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181381.900503:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408392960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181381.900594:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181381.900622:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181381.900642:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408393088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181381.900682:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181381.900763:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408392960 00000100:00100000:3.0:1789181381.900771:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408392960 00000100:00080000:2.0:1789181381.900809:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181381.900815:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408393088 00000100:00100000:3.0:1789181381.900818:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408393088 00000100:00100000:3.0:1789181381.900851:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789181381.900860:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408392960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181381.900892:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181381.900950:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408392960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181381.900957:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789181381.900974:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789181381.900982:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408393088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181381.900991:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181381.901018:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408393088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181381.901023:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789181381.901177:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789181381.901447:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3970000 x1876092408393088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181381.901465:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408393088:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789181381.901505:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c4a80 x1876092408392960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181381.902293:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408392960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181381.996405:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181381.996441:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181381.996462:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181381.996487:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181381.996530:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181381.996551:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181381.996576:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181381.996609:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385245952 00000100:00100000:2.0:1789181381.996619:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385245952 00000100:00100000:2.0:1789181381.996675:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 307 00000100:00100000:2.0:1789181381.996685:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385245952:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181381.996768:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385245952:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181381.996787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 307 00000100:00100000:2.0:1789181381.996821:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385246208 00000100:00100000:2.0:1789181381.996825:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385246208 00000100:00100000:2.0:1789181381.996855:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385246464 00000100:00100000:2.0:1789181381.996858:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385246464 00000100:00100000:2.0:1789181381.996871:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385246080 00000100:00100000:2.0:1789181381.996873:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385246080 00000100:00100000:2.0:1789181381.996883:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385246336 00000100:00100000:2.0:1789181381.996885:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385246336 00000100:00100000:2.0:1789181381.996899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:2.0:1789181381.996905:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385246208:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181381.996934:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385246208:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181381.996939:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:2.0:1789181381.996950:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:2.0:1789181381.996956:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385246464:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181381.996978:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385246464:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181381.996984:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:2.0:1789181381.996994:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:2.0:1789181381.997000:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385246080:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181381.997145:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385246080:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 144us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181381.997152:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:2.0:1789181381.997166:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:2.0:1789181381.997178:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385246336:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181381.997204:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385246336:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181381.997210:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:2.0:1789181381.997231:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385246720 00000100:00100000:2.0:1789181381.997235:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385246720 00000100:00100000:2.0:1789181381.997276:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385246592 00000100:00100000:2.0:1789181381.997279:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385246592 00000100:00100000:2.0:1789181381.997299:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1789181381.997306:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385246720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181381.997330:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385246720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181381.997336:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1789181381.997346:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:2.0:1789181381.997351:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385246592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181381.997370:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385246592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 19us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181381.997376:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00080000:2.0:1789181381.997540:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181381.997544:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181381.997547:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181381.997549:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789181382.159313:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181382.924488:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181382.924523:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408393216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181382.924595:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181382.924976:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408393216 00000100:00100000:1.0:1789181382.924985:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408393216 00000100:00100000:1.0:1789181382.925037:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789181382.925134:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408393216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181382.925170:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789181382.925223:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408393216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181382.927644:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408393216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181382.928066:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00010000:3.0:1789181383.180897:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181383.435875:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408393344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181383.435953:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181383.436044:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408393344 00000100:00100000:3.0:1789181383.436052:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408393344 00000100:00100000:3.0:1789181383.436103:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789181383.436113:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408393344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181383.436140:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181383.436183:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408393344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181383.436190:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1789181383.436230:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb57ca80 x1876092408393344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181383.436249:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408393344:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789181383.436533:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181383.436755:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408393472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181383.436784:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181383.437372:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408393472 00000100:00100000:2.0:1789181383.437379:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408393472 00000100:00100000:2.0:1789181383.437427:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789181383.437436:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408393472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181383.437461:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181383.437797:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408393472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 362us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181383.437805:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789181383.438455:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789181383.438487:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3883800 x1876092408393472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181383.438517:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408393472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181383.441691:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408393728:0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.441795:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181383.441831:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408394240:0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.441851:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181383.441867:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408394752:0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.441884:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181383.441908:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789181383.441913:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408393856:0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.441949:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181383.441966:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408394368:0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.441984:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181383.441998:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408394880:0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.442013:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181383.442037:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408393728 00000100:00100000:1.0:1789181383.442044:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408393728 00000100:00100000:1.0:1789181383.442079:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408394240 00000100:00100000:1.0:1789181383.442081:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408394240 00000100:00100000:1.0:1789181383.442105:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408394752 00000100:00100000:1.0:1789181383.442108:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408394752 00000100:00100000:1.0:1789181383.442121:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408394368 00000100:00100000:1.0:1789181383.442123:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408394368 00000100:00100000:1.0:1789181383.442134:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408394880 00000100:00100000:1.0:1789181383.442137:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408394880 00000100:00100000:1.0:1789181383.442149:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789181383.442157:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408393728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.442220:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408393728:12345-0@lo:400:kworker.0 Request processed in 63us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181383.442228:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789181383.442246:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789181383.442252:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408394240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.442279:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408394240:12345-0@lo:400:kworker.0 Request processed in 27us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181383.442284:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789181383.442295:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789181383.442300:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408394752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.442324:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408394752:12345-0@lo:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181383.442330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789181383.442342:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789181383.442347:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408394368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.442373:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408394368:12345-0@lo:400:kworker.0 Request processed in 25us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181383.442378:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789181383.442388:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789181383.442394:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408394880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.442418:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408394880:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181383.442422:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789181383.442445:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408393856 00000100:00100000:1.0:1789181383.442448:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408393856 00000100:00100000:1.0:1789181383.442482:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789181383.442487:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408393856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181383.443121:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408393600:0@lo:400:kworker.0 00000100:00100000:3.0:1789181383.443162:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181383.443191:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408394112:0@lo:400:kworker.0 00000100:00100000:3.0:1789181383.443212:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181383.443228:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408394624:0@lo:400:kworker.0 00000100:00100000:3.0:1789181383.443245:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181383.443267:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789181383.443273:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408393984:0@lo:400:kworker.0 00000100:00100000:3.0:1789181383.443304:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181383.443319:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408394496:0@lo:400:kworker.0 00000100:00100000:3.0:1789181383.443336:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181383.443380:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408394624 00000100:00100000:3.0:1789181383.443386:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408394624 00000100:00100000:3.0:1789181383.443416:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408394496 00000100:00100000:3.0:1789181383.443419:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408394496 00000100:00100000:3.0:1789181383.443439:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789181383.443446:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408394624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181383.443485:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408394624:12345-0@lo:400:kworker.0 Request processed in 39us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181383.443491:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789181383.443515:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789181383.443521:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408394496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181383.443548:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408394496:12345-0@lo:400:kworker.0 Request processed in 28us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181383.443554:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789181383.443570:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408393984 00000100:00100000:3.0:1789181383.443573:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408393984 00000100:00100000:3.0:1789181383.443596:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789181383.443602:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408393984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181383.443642:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408393984:12345-0@lo:400:kworker.0 Request processed in 40us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181383.443648:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789181383.443693:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408393984:0@lo:400:kworker.0 00010000:00080000:3.0:1789181383.443706:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3849880 x1876092408394496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181383.443754:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408394496:0@lo:400:kworker.0 00010000:00080000:3.0:1789181383.443768:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360e680 x1876092408394624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181383.443778:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408394624:0@lo:400:kworker.0 00000100:00100000:0.0:1789181383.443948:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408393600 00000100:00100000:0.0:1789181383.443953:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408393600 00000100:00100000:0.0:1789181383.443990:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789181383.443996:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408393600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181383.444033:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408393600:12345-0@lo:400:kworker.0 Request processed in 38us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181383.444039:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789181383.444070:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408393600:0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.453263:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408393856:12345-0@lo:400:kworker.0 Request processed in 10766us (11303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181383.453279:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789181383.453311:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408394112 00000100:00100000:1.0:1789181383.453318:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408394112 00000100:00100000:1.0:1789181383.453346:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789181383.453353:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408394112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.453409:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408394112:12345-0@lo:400:kworker.0 Request processed in 57us (10196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181383.453416:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789181383.453494:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408393856:0@lo:400:kworker.0 00010000:00080000:1.0:1789181383.453528:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc384ad80 x1876092408394368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181383.453539:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408394368:0@lo:400:kworker.0 00010000:00080000:1.0:1789181383.453552:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360ce00 x1876092408394880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181383.453560:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408394880:0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.453573:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408393728:0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.453584:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408394240:0@lo:400:kworker.0 00000100:00100000:1.0:1789181383.453594:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408394752:0@lo:400:kworker.0 00000100:00100000:3.0:1789181383.453741:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408394112:0@lo:400:kworker.0 00000100:00080000:1.0:1789181383.453838:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181383.453859:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181383.453862:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789181384.204164:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181385.228961:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181385.486974:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408395008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181385.487059:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181385.487157:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408395008 00000100:00100000:2.0:1789181385.487166:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408395008 00000100:00100000:2.0:1789181385.487227:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789181385.487238:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408395008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789181385.487280:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789181385.491031:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408395008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3785us (3962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181385.491046:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789181385.492830:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408395008:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1789181386.014528:0:12508:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789181386.015033:0:12508:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789181386.252297:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181387.021159:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408395136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181387.021281:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181387.021373:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408395136 00000100:00100000:0.0:1789181387.021382:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408395136 00000100:00100000:0.0:1789181387.021441:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789181387.021454:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408395136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181387.021502:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181387.021547:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408395136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181387.021555:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789181387.021577:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181387.021620:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3882d80 x1876092408395136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181387.021639:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408395136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181387.022061:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408395264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181387.022097:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181387.022193:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408395264 00000100:00100000:3.0:1789181387.022199:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408395264 00000100:00100000:3.0:1789181387.022285:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789181387.022294:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408395264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181387.022307:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181387.022357:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408395264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181387.022363:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789181387.022442:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181387.023136:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb57dc00 x1876092408395264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181387.023154:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408395264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181387.112509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181387.112549:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181387.112591:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181387.112630:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181387.112653:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181387.112673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181387.112700:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181387.112705:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385246976 00000100:00100000:1.0:1789181387.112717:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385246976 00000100:00100000:3.0:1789181387.112720:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385247232 00000100:00100000:3.0:1789181387.112743:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385247232 00000100:00100000:1.0:1789181387.112797:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385247104 00000100:00100000:1.0:1789181387.112801:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385247104 00000100:00100000:2.0:1789181387.115819:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385247360 00000100:00100000:2.0:1789181387.115833:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385247360 00000100:00100000:3.0:1789181387.115994:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1789181387.116007:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385246976:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181387.116111:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385246976:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 107us (3649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181387.116119:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1789181387.116137:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1789181387.116145:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385247232:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181387.116171:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385247232:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (3621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181387.116177:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1789181387.116204:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385247488 00000100:00100000:3.0:1789181387.116208:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385247488 00000100:00100000:3.0:1789181387.116251:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385247616 00000100:00100000:3.0:1789181387.116254:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385247616 00000100:00100000:3.0:1789181387.116275:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1789181387.116283:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385247488:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181387.116308:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385247488:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (3717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181387.116315:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1789181387.116341:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:3.0:1789181387.116347:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385247616:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181387.116372:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385247616:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (3671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181387.116378:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1789181387.118153:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:1.0:1789181387.118165:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385247104:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181387.118221:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385247104:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 59us (5568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181387.118228:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00080000:0.0:1789181387.120897:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181387.120920:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789181387.120924:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789181387.120927:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181387.121450:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:2.0:1789181387.121479:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385247360:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181387.121577:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385247360:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 117us (8902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181387.121585:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:2.0:1789181387.121627:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385246848 00000100:00100000:2.0:1789181387.121634:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385246848 00000100:00100000:2.0:1789181387.121661:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 309 00000100:00100000:2.0:1789181387.121667:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385246848:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181387.121691:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385246848:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (9061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181387.121705:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 309 00010000:00010000:3.0:1789181387.278757:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789181387.974479:0:12605:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181387.974881:0:12605:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789181388.046960:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408395392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181388.047043:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181388.047136:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408395392 00000100:00100000:2.0:1789181388.047146:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408395392 00000100:00100000:2.0:1789181388.047191:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789181388.047199:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408395392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789181388.047238:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789181388.047299:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408395392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181388.047306:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789181388.047355:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408395392:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789181388.300475:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181388.555991:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408395776:0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.556090:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181388.556232:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408395648:0@lo:400:kworker.0 00000100:00100000:0.0:1789181388.556276:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181388.556308:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181388.556314:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408395520:0@lo:400:kworker.0 00000100:00100000:0.0:1789181388.556346:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181388.556388:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408395776 00000100:00100000:0.0:1789181388.556397:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408395776 00000100:00100000:0.0:1789181388.556450:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408395648 00000100:00100000:3.0:1789181388.556799:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408396032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181388.556836:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181388.556872:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408396032 00000100:00100000:3.0:1789181388.556876:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408396032 00000100:00100000:3.0:1789181388.556916:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789181388.556925:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408396032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181388.556953:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181388.556994:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408396032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181388.557000:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1789181388.557039:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc360e680 x1876092408396032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181388.557055:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408396032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181388.557141:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408395648 00000100:00100000:0.0:1789181388.557165:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789181388.557171:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408395776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181388.557236:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789181388.557244:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408395648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181388.557275:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408395648:12345-0@lo:400:kworker.0 Request processed in 33us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181388.557300:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789181388.559421:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181388.559511:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408395776:12345-0@lo:400:kworker.0 Request processed in 2335us (3416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181388.559523:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789181388.559563:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408395520 00000100:00100000:0.0:1789181388.559571:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408395520 00000100:00100000:0.0:1789181388.559618:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789181388.559625:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408395520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181388.559681:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408395520:12345-0@lo:400:kworker.0 Request processed in 57us (3335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181388.559687:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:0.0:1789181388.559713:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181388.559756:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408395520:0@lo:400:kworker.0 00000100:00100000:0.0:1789181388.559770:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408395648:0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.560006:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408395776:0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.560028:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408396288:0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.560063:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181388.560087:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789181388.560093:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408395904:0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.560112:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181388.560127:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408396416:0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.560158:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181388.560247:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408396288 00000100:00100000:0.0:1789181388.560252:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408396288 00000100:00100000:0.0:1789181388.560299:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789181388.560305:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408396288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181388.560341:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408396288:12345-0@lo:400:kworker.0 Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181388.560347:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1789181388.560360:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181388.560370:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408396672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181388.560393:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181388.560412:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181388.560417:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408396544:0@lo:400:kworker.0 00000100:00100000:0.0:1789181388.560433:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181388.560468:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408396416 00000100:00100000:0.0:1789181388.560473:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408396416 00000100:00100000:0.0:1789181388.560502:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408396544 00000100:00100000:0.0:1789181388.560505:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408396544 00000100:00100000:0.0:1789181388.560522:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789181388.560528:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408396416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181388.560557:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408396416:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181388.560563:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789181388.560584:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789181388.560591:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408396544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181388.560622:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408396544:12345-0@lo:400:kworker.0 Request processed in 31us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181388.560627:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789181388.560657:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408396672 00000100:00100000:0.0:1789181388.560662:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408396672 00000100:00100000:0.0:1789181388.560692:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789181388.560698:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408396672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181388.560716:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181388.560772:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408396672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181388.560778:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789181388.560795:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789181388.560813:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc387a300 x1876092408396544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181388.560825:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408396544:0@lo:400:kworker.0 00010000:00080000:0.0:1789181388.560835:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3881500 x1876092408396672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181388.560852:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408396672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181388.561431:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408396160:0@lo:400:kworker.0 00000100:00100000:3.0:1789181388.561491:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181388.561529:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408396160 00000100:00100000:3.0:1789181388.561535:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408396160 00000100:00100000:3.0:1789181388.561572:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1789181388.561804:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181388.561885:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408396160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181388.561936:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408396160:12345-0@lo:400:kworker.0 Request processed in 54us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181388.562046:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408395904 00000100:00100000:2.0:1789181388.562051:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408395904 00000100:00100000:2.0:1789181388.562108:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789181388.562115:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408395904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.562164:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408395904:12345-0@lo:400:kworker.0 Request processed in 50us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181388.562170:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789181388.562204:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408396928:0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.562243:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181388.562277:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181388.562284:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408396800:0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.562306:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181388.562332:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408396928 00000100:00100000:2.0:1789181388.562336:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408396928 00000100:00100000:0.0:1789181388.562679:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408396800 00000100:00100000:0.0:1789181388.562684:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408396800 00000100:00100000:0.0:1789181388.562705:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789181388.562712:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408396800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181388.562788:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408396800:12345-0@lo:400:kworker.0 Request processed in 77us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181388.562795:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789181388.562989:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408396800:0@lo:400:kworker.0 00000100:00100000:3.0:1789181388.563708:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1789181388.563835:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181388.563840:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181388.563931:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408396160:0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.564156:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789181388.564171:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408396928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.564443:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408396928:12345-0@lo:400:kworker.0 Request processed in 277us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181388.564451:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00080000:1.0:1789181388.564531:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3879f80 x1876092408396928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181388.564545:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408396928:0@lo:400:kworker.0 00000100:00100000:2.0:1789181388.564708:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408395904:0@lo:400:kworker.0 00010000:00080000:2.0:1789181388.564876:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3878700 x1876092408396416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181388.564888:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408396416:0@lo:400:kworker.0 00010000:00080000:2.0:1789181388.564906:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3879500 x1876092408396288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181388.564914:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408396288:0@lo:400:kworker.0 00010000:00010000:2.0:1789181389.324902:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789181389.818506:0:12702:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789181389.818698:0:12702:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789181390.348658:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181390.607532:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181390.607558:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408397056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181390.607651:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181390.607719:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408397056 00000100:00100000:1.0:1789181390.607746:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408397056 00000100:00100000:1.0:1789181390.607802:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789181390.607811:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408397056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181390.607852:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181390.607902:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408397056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181390.607909:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789181390.607953:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408397056:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789181391.372849:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789181392.086974:0:12800:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789181392.087516:0:12800:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789181392.140981:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181392.141006:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408397312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181392.141088:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181392.141450:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408397184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181392.141501:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181392.141555:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408397312 00000100:00100000:0.0:1789181392.141562:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408397312 00000100:00100000:0.0:1789181392.141615:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408397184 00000100:00100000:0.0:1789181392.141618:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408397184 00000100:00100000:0.0:1789181392.141634:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789181392.141643:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408397312:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789181392.141959:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789181392.142163:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181392.142592:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408397312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 948us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181392.142600:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789181392.142624:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789181392.142634:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408397184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181392.142648:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181392.142688:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408397184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181392.142694:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1789181392.143296:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34fb100 x1876092408397312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181392.143320:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408397312:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789181392.143523:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3883800 x1876092408397184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181392.143536:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408397184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181392.232776:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181392.232827:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181392.232855:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181392.232878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181392.232920:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181392.232953:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385247872 00000100:00100000:3.0:1789181392.232964:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385247872 00000100:00100000:3.0:1789181392.233043:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385248128 00000100:00100000:3.0:1789181392.233047:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385248128 00000100:00100000:3.0:1789181392.233083:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:3.0:1789181392.233105:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385247872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181392.233195:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385247872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 93us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181392.233203:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:3.0:1789181392.233221:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:3.0:1789181392.233237:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385248128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181392.233260:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385248128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 33us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181392.233277:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:3.0:1789181392.233296:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385247744 00000100:00100000:3.0:1789181392.233300:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385247744 00000100:00100000:3.0:1789181392.233341:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 311 00000100:00100000:3.0:1789181392.233347:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385247744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181392.233372:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385247744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181392.233378:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 311 00000100:00100000:3.0:1789181392.233403:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385248384 00000100:00100000:3.0:1789181392.233407:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385248384 00000100:00100000:3.0:1789181392.233444:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385248512 00000100:00100000:3.0:1789181392.233448:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385248512 00000100:00100000:3.0:1789181392.233470:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1789181392.233476:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2392:x1876092385248384:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:3.0:1789181392.233495:0:8436:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb5552835170cf 00000100:00080000:3.0:1789181392.233504:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c1cc38d6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789181392.233546:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789181392.233666:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+2:2392:x1876092385248384:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 190us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181392.233673:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1789181392.233686:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:3.0:1789181392.233693:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2392:x1876092385248512:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:3.0:1789181392.233703:0:8436:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb5552835170d6 00000100:00080000:3.0:1789181392.233709:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9c1cc38d3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789181392.233755:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789181392.233824:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+2:2392:x1876092385248512:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 132us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181392.233832:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00080000:3.0:1789181392.233853:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181392.233857:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181392.233859:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789181392.233999:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181392.234004:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181392.237839:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181392.237882:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181392.237912:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385248000 00000100:00100000:2.0:1789181392.237922:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385248000 00000100:00100000:2.0:1789181392.237976:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385248256 00000100:00100000:2.0:1789181392.237980:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385248256 00000100:00100000:2.0:1789181392.238001:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:2.0:1789181392.238010:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385248000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181392.238095:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385248000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181392.238104:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:2.0:1789181392.238122:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:2.0:1789181392.238129:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385248256:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181392.238152:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385248256:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181392.238158:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00080000:2.0:1789181392.238174:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789181392.397506:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181393.176615:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408397440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181393.176708:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181393.176782:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408397440 00000100:00100000:0.0:1789181393.176804:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408397440 00000100:00100000:0.0:1789181393.176856:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789181393.176867:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408397440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181393.176905:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789181393.187585:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408397440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10701us (10858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181393.187602:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789181393.192361:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408397440:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789181393.419846:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181393.675888:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408397696:0@lo:400:kworker.0 00000100:00100000:3.0:1789181393.675969:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181393.675970:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408397952:0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.676001:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181393.676026:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408398464:0@lo:400:kworker.0 00000100:00100000:3.0:1789181393.676034:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408398208:0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.676047:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181393.676065:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408398976:0@lo:400:kworker.0 00000100:00100000:3.0:1789181393.676066:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181393.676080:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408398720:0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.676083:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181393.676098:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181393.676100:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789181393.676105:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408397824:0@lo:400:kworker.0 00000100:00100000:3.0:1789181393.676109:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789181393.676114:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408397568:0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.676124:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181393.676139:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181393.676139:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408398336:0@lo:400:kworker.0 00000100:00100000:3.0:1789181393.676156:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408398080:0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.676157:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181393.676183:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408398848:0@lo:400:kworker.0 00000100:00100000:3.0:1789181393.676192:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181393.676200:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181393.676202:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408398592:0@lo:400:kworker.0 00000100:00100000:3.0:1789181393.676218:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181393.676237:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408397952 00000100:00100000:1.0:1789181393.676245:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408397952 00000100:00100000:2.0:1789181393.676289:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408397696 00000100:00100000:2.0:1789181393.676294:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408397696 00000100:00100000:2.0:1789181393.676340:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408398208 00000100:00100000:2.0:1789181393.676343:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408398208 00000100:00100000:2.0:1789181393.676372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408398720 00000100:00100000:2.0:1789181393.676375:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408398720 00000100:00100000:2.0:1789181393.676386:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408397824 00000100:00100000:2.0:1789181393.676389:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408397824 00000100:00100000:2.0:1789181393.676398:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408398080 00000100:00100000:2.0:1789181393.676400:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408398080 00000100:00100000:2.0:1789181393.676422:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408398592 00000100:00100000:2.0:1789181393.676425:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408398592 00000100:00100000:2.0:1789181393.676440:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789181393.676449:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408397696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181393.676511:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408397696:12345-0@lo:400:kworker.0 Request processed in 63us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181393.676518:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789181393.676535:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789181393.676541:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408398208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181393.676567:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408398208:12345-0@lo:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181393.676573:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789181393.676584:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789181393.676589:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408398720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181393.676611:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408398720:12345-0@lo:400:kworker.0 Request processed in 23us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181393.676616:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789181393.676625:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1789181393.676677:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181393.676682:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181393.676954:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408399104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181393.676985:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181393.677021:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408399104 00000100:00100000:3.0:1789181393.677025:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408399104 00000100:00100000:3.0:1789181393.677086:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789181393.677094:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408399104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181393.677117:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181393.677154:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408399104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181393.677161:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1789181393.677180:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789181393.677203:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4378a80 x1876092408399104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181393.677221:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408399104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181393.677548:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789181393.677557:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408397952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.677605:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408397952:12345-0@lo:400:kworker.0 Request processed in 50us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181393.677611:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789181393.677630:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408398464 00000100:00100000:1.0:1789181393.677634:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408398464 00000100:00100000:1.0:1789181393.677651:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408398976 00000100:00100000:1.0:1789181393.677654:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408398976 00000100:00100000:1.0:1789181393.677672:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408398336 00000100:00100000:1.0:1789181393.677675:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408398336 00000100:00100000:1.0:1789181393.677685:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408398848 00000100:00100000:1.0:1789181393.677688:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408398848 00000100:00100000:1.0:1789181393.677699:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789181393.677706:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408398464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.677749:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408398464:12345-0@lo:400:kworker.0 Request processed in 43us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181393.677750:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408397824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.677755:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789181393.677765:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789181393.677770:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408398976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181393.677780:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408397824:12345-0@lo:400:kworker.0 Request processed in 32us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181393.677792:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408398976:12345-0@lo:400:kworker.0 Request processed in 22us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181393.677796:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789181393.677806:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789181393.677811:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408398336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.677834:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408398336:12345-0@lo:400:kworker.0 Request processed in 24us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181393.677849:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789181393.677860:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789181393.677865:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408398848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.677892:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408398848:12345-0@lo:400:kworker.0 Request processed in 28us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181393.677897:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789181393.677913:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181393.677935:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408397824:0@lo:400:kworker.0 00010000:00080000:1.0:1789181393.677947:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbd180 x1876092408398336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181393.677957:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408398336:0@lo:400:kworker.0 00010000:00080000:1.0:1789181393.677966:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbe680 x1876092408398848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181393.677974:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408398848:0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.677991:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408397952:0@lo:400:kworker.0 00010000:00080000:1.0:1789181393.678002:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbd500 x1876092408398464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181393.678010:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408398464:0@lo:400:kworker.0 00010000:00080000:1.0:1789181393.678020:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbf480 x1876092408398976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181393.678028:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408398976:0@lo:400:kworker.0 00000100:00100000:3.0:1789181393.679965:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408397568 00000100:00100000:3.0:1789181393.679979:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408397568 00000100:00100000:3.0:1789181393.680035:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789181393.680055:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408397568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181393.680131:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408397568:12345-0@lo:400:kworker.0 Request processed in 87us (3991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181393.680138:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789181393.681130:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789181393.681149:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408398080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.681237:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408399232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181393.684764:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789181393.684824:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789181393.684844:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408398592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.685249:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181393.685308:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408397568:0@lo:400:kworker.0 00010000:00080000:1.0:1789181393.685328:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3878000 x1876092408398208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181393.685340:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408398208:0@lo:400:kworker.0 00010000:00080000:1.0:1789181393.685351:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbed80 x1876092408398720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181393.685360:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408398720:0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.685372:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408397696:0@lo:400:kworker.0 00000100:00100000:1.0:1789181393.685422:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408399232 00000100:00100000:1.0:1789181393.685429:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408399232 00000100:00100000:1.0:1789181393.685466:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789181393.685473:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408399232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181393.685491:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181393.685527:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408399232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181393.685529:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408398080:12345-0@lo:400:kworker.0 Request processed in 4388us (9334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181393.685533:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789181393.685536:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00080000:1.0:1789181393.685560:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb2a8a80 x1876092408399232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181393.685574:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408399232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181393.685585:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408398080:0@lo:400:kworker.0 00000100:00100000:2.0:1789181393.686545:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408398592:12345-0@lo:400:kworker.0 Request processed in 1701us (10315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181393.686557:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789181393.688489:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408398592:0@lo:400:kworker.0 00000020:00000004:2.0:1789181394.201562:0:12898:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789181394.201919:0:12898:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789181394.443885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181395.469538:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181395.724012:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408399360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181395.724088:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181395.724194:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408399360 00000100:00100000:0.0:1789181395.724202:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408399360 00000100:00100000:0.0:1789181395.724264:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789181395.724274:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408399360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789181395.724309:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789181395.724891:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408399360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 617us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181395.724899:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789181395.728490:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408399360:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789181396.495240:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181397.261063:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408399488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181397.261147:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181397.261340:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408399488 00000100:00100000:2.0:1789181397.261347:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408399488 00000100:00100000:2.0:1789181397.261423:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789181397.261435:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408399488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181397.261468:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181397.261521:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408399488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181397.261527:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1789181397.261569:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34fb480 x1876092408399488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181397.261588:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408399488:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789181397.261653:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181397.262857:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181397.262872:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408399616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181397.262934:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181397.263672:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408399616 00000100:00100000:2.0:1789181397.263690:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408399616 00000100:00100000:2.0:1789181397.263775:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789181397.263785:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408399616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789181397.263819:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181397.263883:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408399616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181397.263890:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789181397.264072:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34fb480 x1876092408399616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181397.264091:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408399616:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789181397.264157:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181397.363164:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181397.363214:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181397.363244:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181397.363278:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181397.363300:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181397.363333:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385248896 00000100:00100000:3.0:1789181397.363344:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385248896 00000100:00100000:3.0:1789181397.363410:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385249152 00000100:00100000:3.0:1789181397.363414:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385249152 00000100:00100000:3.0:1789181397.363428:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385248768 00000100:00100000:3.0:1789181397.363430:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385248768 00000100:00100000:3.0:1789181397.363441:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385249024 00000100:00100000:3.0:1789181397.363442:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385249024 00000100:00100000:3.0:1789181397.363457:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:3.0:1789181397.363481:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385248896:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181397.363560:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385248896:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181397.363568:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:3.0:1789181397.363585:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:3.0:1789181397.363592:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385249152:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181397.363619:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385249152:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181397.363643:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:3.0:1789181397.363655:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:3.0:1789181397.363661:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385248768:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181397.363685:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385248768:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181397.363691:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:3.0:1789181397.363700:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:3.0:1789181397.363706:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385249024:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181397.363767:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385249024:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 60us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181397.363773:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00080000:3.0:1789181397.363905:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181397.363909:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181397.364133:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385248640 00000100:00100000:0.0:1789181397.364141:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385248640 00000100:00100000:0.0:1789181397.364184:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 313 00000100:00100000:0.0:1789181397.364191:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385248640:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181397.364230:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385248640:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181397.364236:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 313 00010000:00010000:1.0:1789181397.518559:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789181397.773221:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000020:00000080:3.0:1789181397.773230:0:9516:0:(genops.c:885:class_export_put()) final put ffff9c1cc38d4800/d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000020:00000080:3.0:1789181397.773250:0:12865:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc38d4800/d0e89ea0-dcb5-49cb-8994-643fecfb5dac for lustre-OST0001 00000020:00000080:3.0:1789181397.773288:0:12865:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc38d3800 for lustre-OST0001 00000001:00100000:1.0:1789181397.774217:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000020:00000080:1.0:1789181397.774224:0:8431:0:(genops.c:885:class_export_put()) final put ffff9c1cc38d1800/d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000020:00000080:1.0:1789181397.774240:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc38d1800/d0e89ea0-dcb5-49cb-8994-643fecfb5dac for lustre-OST0000 00000020:00000080:1.0:1789181397.774267:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc38d6800 for lustre-OST0000 00000100:00100000:3.0:1789181398.283840:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181398.283862:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408399744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181398.283926:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181398.283983:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408399744 00000100:00100000:3.0:1789181398.283991:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408399744 00000100:00100000:3.0:1789181398.284032:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789181398.284041:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408399744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181398.284076:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789181398.284628:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408399744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 586us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181398.284638:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789181398.284690:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408399744:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1789181398.504124:0:13042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789181398.554245:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181398.796273:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408399872:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796354:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796452:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408400384:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796493:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796510:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408400896:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796531:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796555:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789181398.796561:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408400000:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796601:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408400512:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796619:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796644:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408401024:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796665:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796689:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408400256:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796714:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796759:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408400768:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796781:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796798:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408401280:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796816:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796833:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789181398.796838:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408400128:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796858:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796868:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408400640:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796886:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796901:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408401152:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.796917:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181398.796943:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408400384 00000100:00100000:1.0:1789181398.796950:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408400384 00000100:00100000:1.0:1789181398.796993:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408400896 00000100:00100000:1.0:1789181398.796996:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408400896 00000100:00100000:1.0:1789181398.797011:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408400000 00000100:00100000:1.0:1789181398.797014:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408400000 00000100:00100000:1.0:1789181398.797023:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408400512 00000100:00100000:1.0:1789181398.797026:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408400512 00000100:00100000:1.0:1789181398.797037:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408401024 00000100:00100000:1.0:1789181398.797039:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408401024 00000100:00100000:1.0:1789181398.797049:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408400128 00000100:00100000:1.0:1789181398.797052:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408400128 00000100:00100000:1.0:1789181398.797064:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789181398.797080:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408400384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797137:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408400384:12345-0@lo:400:kworker.0 Request processed in 58us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797144:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789181398.797162:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789181398.797169:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408400896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797198:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408400896:12345-0@lo:400:kworker.0 Request processed in 31us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797203:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789181398.797213:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789181398.797218:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408400000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797243:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408400000:12345-0@lo:400:kworker.0 Request processed in 25us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797247:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789181398.797257:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789181398.797262:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408400512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797286:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408400512:12345-0@lo:400:kworker.0 Request processed in 24us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797291:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789181398.797303:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789181398.797309:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408401024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797333:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408401024:12345-0@lo:400:kworker.0 Request processed in 25us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797339:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789181398.797349:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789181398.797373:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408400128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797407:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408400128:12345-0@lo:400:kworker.0 Request processed in 47us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797413:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789181398.797439:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408400256 00000100:00100000:1.0:1789181398.797443:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408400256 00000100:00100000:1.0:1789181398.797465:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789181398.797472:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408400256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797502:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408400256:12345-0@lo:400:kworker.0 Request processed in 30us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797507:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789181398.797524:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408400768 00000100:00100000:1.0:1789181398.797527:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408400768 00000100:00100000:1.0:1789181398.797543:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408401280 00000100:00100000:1.0:1789181398.797546:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408401280 00000100:00100000:1.0:1789181398.797558:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408400640 00000100:00100000:1.0:1789181398.797560:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408400640 00000100:00100000:1.0:1789181398.797569:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408401152 00000100:00100000:1.0:1789181398.797571:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408401152 00000100:00100000:1.0:1789181398.797583:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789181398.797589:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408400768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797618:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408400768:12345-0@lo:400:kworker.0 Request processed in 30us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797624:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789181398.797635:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789181398.797641:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408401280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797667:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408401280:12345-0@lo:400:kworker.0 Request processed in 26us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797681:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789181398.797691:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789181398.797697:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408400640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797749:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408400640:12345-0@lo:400:kworker.0 Request processed in 52us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797755:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789181398.797765:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789181398.797771:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408401152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797796:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408401152:12345-0@lo:400:kworker.0 Request processed in 25us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181398.797802:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789181398.797849:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408400128:0@lo:400:kworker.0 00010000:00080000:1.0:1789181398.797863:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbe680 x1876092408400640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181398.797872:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408400640:0@lo:400:kworker.0 00010000:00080000:1.0:1789181398.797880:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3878000 x1876092408401152/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181398.797887:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408401152:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797896:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408400256:0@lo:400:kworker.0 00010000:00080000:1.0:1789181398.797904:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbd180 x1876092408400768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181398.797912:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408400768:0@lo:400:kworker.0 00010000:00080000:1.0:1789181398.797934:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc387bb80 x1876092408401280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181398.797942:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408401280:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.797981:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408400000:0@lo:400:kworker.0 00010000:00080000:1.0:1789181398.797991:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbd500 x1876092408400512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181398.797999:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408400512:0@lo:400:kworker.0 00010000:00080000:1.0:1789181398.798008:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3878380 x1876092408401024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181398.798016:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408401024:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.798026:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408400384:0@lo:400:kworker.0 00000100:00100000:1.0:1789181398.798034:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408400896:0@lo:400:kworker.0 00000100:00100000:2.0:1789181398.798412:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181398.798425:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408401408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181398.798476:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181398.798510:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408401408 00000100:00100000:2.0:1789181398.798516:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408401408 00000100:00100000:2.0:1789181398.798544:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789181398.798551:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408401408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181398.798574:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181398.798610:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408401408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181398.798616:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1789181398.798641:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34f9500 x1876092408401408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181398.798654:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408401408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181398.798889:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408399872 00000100:00100000:3.0:1789181398.798894:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408399872 00000100:00100000:3.0:1789181398.798925:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789181398.798931:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408399872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181398.798968:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408399872:12345-0@lo:400:kworker.0 Request processed in 38us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181398.798974:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:3.0:1789181398.799001:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181398.799006:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181398.799009:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181398.799870:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408401536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181398.799911:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181398.800100:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408401536 00000100:00100000:0.0:1789181398.800106:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408401536 00000100:00100000:0.0:1789181398.800147:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789181398.800155:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408401536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181398.800184:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181398.800221:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408401536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181398.800227:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1789181398.800765:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c6300 x1876092408401536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181398.800784:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408401536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181398.800940:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408399872:0@lo:400:kworker.0 00010000:00010000:2.0:1789181399.564278:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181400.593284:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181400.844893:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181400.844918:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408401664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181400.845000:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181400.845069:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408401664 00000100:00100000:1.0:1789181400.845075:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408401664 00000100:00100000:1.0:1789181400.845131:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789181400.845140:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408401664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181400.845177:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181400.845221:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408401664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181400.845233:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789181400.845280:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408401664:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789181401.611978:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181402.383947:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408401792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181402.384027:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181402.384273:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408401920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181402.384305:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181402.384352:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408401792 00000100:00100000:3.0:1789181402.384360:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408401792 00000100:00100000:3.0:1789181402.384413:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408401920 00000100:00100000:3.0:1789181402.384416:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408401920 00000100:00100000:3.0:1789181402.384437:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789181402.384461:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408401792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181402.384493:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181402.384534:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408401792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181402.384542:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789181402.384558:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789181402.384564:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408401920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181402.384573:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181402.384600:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408401920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181402.384606:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789181402.384622:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181402.384651:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4301180 x1876092408401920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181402.384670:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408401920:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789181402.385115:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34f9500 x1876092408401792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181402.385129:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408401792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181402.472414:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181402.472459:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181402.472487:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181402.472516:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181402.472540:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181402.472571:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385249536 00000100:00100000:3.0:1789181402.472581:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385249536 00000100:00100000:3.0:1789181402.472628:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385249792 00000100:00100000:3.0:1789181402.472631:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385249792 00000100:00100000:3.0:1789181402.472641:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385249408 00000100:00100000:3.0:1789181402.472643:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385249408 00000100:00100000:3.0:1789181402.472653:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385249664 00000100:00100000:3.0:1789181402.472668:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385249664 00000100:00100000:3.0:1789181402.472685:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:3.0:1789181402.472694:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385249536:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181402.473046:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385249536:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 350us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181402.473055:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:3.0:1789181402.473073:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:3.0:1789181402.473079:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385249792:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181402.473202:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:0.0:1789181402.473213:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385249408:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181402.473243:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385249408:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181402.473249:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:0.0:1789181402.473262:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:0.0:1789181402.473268:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385249664:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181402.473290:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385249664:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181402.473296:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:2.0:1789181402.473454:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385249280 00000100:00100000:2.0:1789181402.473460:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385249280 00000100:00100000:2.0:1789181402.473491:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 315 00000100:00100000:2.0:1789181402.473498:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385249280:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181402.473527:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385249280:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181402.473546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 315 00000100:00080000:2.0:1789181402.474229:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181402.474237:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181402.477650:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385249792:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 4560us (5151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181402.477664:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00010000:00010000:3.0:1789181402.636665:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789181402.744661:0:13190:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8c825560 20000000:00000080:3.0:1789181402.744687:0:13190:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c1cc37c8800 uarg=0000000000000000 20000000:01000000:3.0:1789181402.744772:0:13190:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789181402.744778:0:13190:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789181402.744783:0:13190:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789181402.748689:0:13191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789181402.748932:0:13190:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789181402.764138:0:13190:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789181402.764660:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.764680:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658be00/0x76fb55528351706d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dee expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.764689:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351707b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517074 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.764696:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517082 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.764703:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1523400/0x76fb555283517097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517090 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.764710:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1522800/0x76fb5552835170a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351709e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.764717:0:13190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658ac00/0x76fb5552835170ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e2d expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.764761:0:13190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.764819:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658ac00/0x76fb5552835170ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e2d expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.764833:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1dc658ac00/0x76fb5552835170ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e2d expref: 12 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181402.764865:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402048:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181402.764973:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1522800/0x76fb5552835170a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb55528351709e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.764982:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1dc1522800/0x76fb5552835170a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb55528351709e expref: 23 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181402.764991:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402176:0@lo:104: 00000100:00100000:1.0:1789181402.765035:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181402.765075:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1523400/0x76fb555283517097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283517090 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.765097:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1dc1523400/0x76fb555283517097 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283517090 expref: 23 pid: 6516 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181402.765104:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402304:0@lo:104: 00000100:00100000:1.0:1789181402.765125:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181402.765157:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283517082 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.765165:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517089 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283517082 expref: 23 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181402.765173:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402432:0@lo:104: 00000100:00100000:2.0:1789181402.765183:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408402176 00000100:00100000:2.0:1789181402.765192:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408402176 00000100:00100000:1.0:1789181402.765192:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181402.765215:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351707b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283517074 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181402.765231:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408402304 00010000:00010000:1.0:1789181402.765233:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351707b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283517074 expref: 23 pid: 6516 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181402.765234:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408402304 00000100:00100000:1.0:1789181402.765241:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402560:0@lo:104: 00000100:00100000:2.0:1789181402.765243:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408402432 00000100:00100000:2.0:1789181402.765245:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408402432 00000100:00100000:2.0:1789181402.765257:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789181402.765262:0:13190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181402.765266:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+5:13190:x1876092408402176:12345-0@lo:104: 00010000:00010000:1.0:1789181402.765278:0:13190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658be00/0x76fb55528351706d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dee expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765279:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.765286:0:13190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1dc658be00/0x76fb55528351706d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dee expref: 12 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181402.765294:0:13190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402688:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181402.765314:0:13190:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc26e4000 going to sleep for 11 seconds 00010000:00010000:2.0:1789181402.765390:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789181402.765398:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+5:13190:x1876092408402176:12345-0@lo:104: Request processed in 133us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181402.765405:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789181402.765422:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408402560 00000100:00100000:2.0:1789181402.765426:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408402560 00000100:00100000:2.0:1789181402.765439:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789181402.765445:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+5:13190:x1876092408402304:12345-0@lo:104: 00010000:00010000:2.0:1789181402.765452:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765486:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789181402.765491:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+5:13190:x1876092408402304:12345-0@lo:104: Request processed in 47us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181402.765506:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789181402.765519:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789181402.765524:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+4:13190:x1876092408402432:12345-0@lo:104: 00010000:00010000:2.0:1789181402.765532:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765558:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789181402.765563:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+4:13190:x1876092408402432:12345-0@lo:104: Request processed in 39us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181402.765568:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789181402.765578:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789181402.765584:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+3:13190:x1876092408402560:12345-0@lo:104: 00010000:00010000:2.0:1789181402.765592:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765616:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789181402.765620:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da575344-f445-48a7-8532-0e6efd2ea878+3:13190:x1876092408402560:12345-0@lo:104: Request processed in 37us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181402.765625:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1789181402.765642:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789181402.765648:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765655:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522a00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181402.765659:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181402.765667:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789181402.765677:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181402.765684:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181402.765690:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181402.765718:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765742:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181402.765761:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765769:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351709e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835170a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181402.765781:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408402816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181402.765782:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181402.765784:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765790:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522400 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181402.765792:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765799:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181402.765806:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181402.765809:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789181402.765816:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181402.765829:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765835:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181402.765849:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765855:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522400/0x76fb555283517082 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517089 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765863:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181402.765866:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765872:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f1200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181402.765874:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765880:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181402.765886:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181402.765891:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789181402.765898:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181402.765901:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181402.765903:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765907:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181402.765910:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e000 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181402.765913:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765918:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181402.765924:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765925:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1200/0x76fb555283517074 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb55528351707b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181402.765931:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.765933:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181402.765935:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789181402.765937:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181402.765937:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181402.765950:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181402.765952:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408402944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181402.765956:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181402.765966:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181402.765973:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb555283517090 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517097 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181402.765986:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181402.765988:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181402.765989:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181402.765990:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181402.765998:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408403200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181402.766007:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181402.766012:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408403072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181402.766022:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181402.766039:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408402816 00000100:00100000:2.0:1789181402.766042:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408402816 00010000:00010000:3.0:1789181402.766048:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181402.766050:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181402.766059:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1522800/0x76fb5552835170a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb55528351709e expref: 24 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181402.766085:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408402944 00000100:00100000:2.0:1789181402.766088:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408402944 00010000:00010000:2.0:1789181402.766099:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517089 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283517082 expref: 25 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181402.766108:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408403200 00000100:00100000:2.0:1789181402.766111:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408403200 00010000:00010000:2.0:1789181402.766120:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1523400/0x76fb555283517097 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283517090 expref: 26 pid: 6516 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181402.766134:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789181402.766139:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+26:3646:x1876092408402816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181402.766159:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181402.766165:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1522800/0x76fb5552835170a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb55528351709e expref: 26 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.766174:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1522800/0x76fb5552835170a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb55528351709e expref: 26 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.766189:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181402.766220:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+26:3646:x1876092408402816:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181402.766226:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789181402.766240:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789181402.766246:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+25:3643:x1876092408402944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181402.766254:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181402.766258:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517089 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283517082 expref: 25 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.766266:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517089 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283517082 expref: 25 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.766276:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181402.766296:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+25:3643:x1876092408402944:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181402.766302:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789181402.766313:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789181402.766319:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408403200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181402.766343:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181402.766347:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1523400/0x76fb555283517097 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283517090 expref: 24 pid: 6516 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.766360:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1523400/0x76fb555283517097 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283517090 expref: 24 pid: 6516 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.766370:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181402.766397:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408403200:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181402.766403:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789181402.766434:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408402816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181402.766457:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408403200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181402.766465:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1522800/0x76fb5552835170a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb55528351709e expref: 23 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181402.766471:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181402.766476:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402176:0@lo:104: 00000100:00100000:2.0:1789181402.766487:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408402944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181402.766487:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523400/0x76fb555283517097 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283517090 expref: 22 pid: 6516 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181402.766495:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402304:0@lo:104: 00000100:00100000:2.0:1789181402.766501:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408403072 00000100:00100000:2.0:1789181402.766503:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408403072 00010000:00010000:1.0:1789181402.766503:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085fa00/0x76fb555283517089 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283517082 expref: 21 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181402.766510:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402432:0@lo:104: 00010000:00010000:2.0:1789181402.766514:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351707b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283517074 expref: 21 pid: 6516 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181402.766517:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402560:0@lo:104: 00000100:00100000:2.0:1789181402.766530:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789181402.766536:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+21:3643:x1876092408403072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181402.766544:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181402.766548:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351707b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283517074 expref: 21 pid: 6516 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.766555:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351707b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283517074 expref: 21 pid: 6516 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.766565:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351707b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283517074 expref: 21 pid: 6516 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.766579:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181402.766618:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+20:3643:x1876092408403072:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181402.766624:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789181402.768875:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408403072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181402.769757:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402688:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181402.769772:0:13190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13190:1876092408402048:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181402.769803:0:13190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181402.781645:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181402.781690:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181402.781795:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385249920 00000100:00100000:3.0:1789181402.781801:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385250048 00000100:00100000:3.0:1789181402.781806:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385250048 00000100:00100000:2.0:1789181402.781806:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385249920 00010000:00010000:2.0:1789181402.781845:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658be00/0x76fb55528351706d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dee expref: 14 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181402.781883:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:2.0:1789181402.781893:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:525f5671-d737-455e-aa6e-3cb90307b925+14:2393:x1876092385249920:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181402.781908:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181402.781914:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc658be00/0x76fb55528351706d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dee expref: 14 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.781924:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658be00/0x76fb55528351706d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dee expref: 14 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.781943:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658be00/0x76fb55528351706d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dee expref: 14 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181402.781959:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181402.782082:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385249920:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 189us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181402.782091:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00010000:00010000:3.0:1789181402.786354:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658ac00/0x76fb5552835170ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e2d expref: 13 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181402.786587:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1789181402.786609:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385250048:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181402.786643:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181402.786650:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc658ac00/0x76fb5552835170ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e2d expref: 13 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786664:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658ac00/0x76fb5552835170ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e2d expref: 13 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786683:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658ac00/0x76fb5552835170ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e2d expref: 13 pid: 6515 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786711:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786721:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786765:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786773:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786780:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786787:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786794:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181402.786798:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786817:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786839:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181402.786849:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181402.786926:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:525f5671-d737-455e-aa6e-3cb90307b925+12:2393:x1876092385250048:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 327us (5234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181402.786934:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00010000:00010000:1.0:1789181402.787130:0:13190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.787139:0:13190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181402.787145:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f0400/0x76fb5552835170dd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181403.405918:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408403328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181403.406014:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181403.406282:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408403328 00000100:00100000:3.0:1789181403.406299:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408403328 00000100:00100000:3.0:1789181403.406369:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789181403.406379:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408403328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181403.406415:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789181403.406478:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408403328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181403.406485:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789181403.406581:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408403328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789181403.659999:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181403.917864:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408403584:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.917941:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.917994:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408404096:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918020:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918038:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408404608:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918058:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918083:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789181403.918089:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408403456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181403.918112:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918129:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408403968:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918164:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918180:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408404480:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918203:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918220:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408404992:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918237:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918262:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408403712:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918282:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918300:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408404224:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918334:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918351:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408404736:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918370:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918382:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789181403.918387:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408403840:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918404:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918414:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408404352:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918432:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918520:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408404864:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918542:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.918597:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408403584 00000100:00100000:1.0:1789181403.918604:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408403584 00000100:00100000:1.0:1789181403.918648:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789181403.918657:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:3644:x1876092408403584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918706:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+20:3644:x1876092408403584:12345-0@lo:400:kworker.0 Request processed in 50us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.918742:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789181403.918775:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408404096 00000100:00100000:1.0:1789181403.918779:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408404096 00000100:00100000:1.0:1789181403.918823:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408404608 00000100:00100000:1.0:1789181403.918826:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408404608 00000100:00100000:1.0:1789181403.918839:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408403712 00000100:00100000:1.0:1789181403.918841:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408403712 00000100:00100000:1.0:1789181403.918850:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408404224 00000100:00100000:1.0:1789181403.918852:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408404224 00000100:00100000:1.0:1789181403.918861:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408404736 00000100:00100000:1.0:1789181403.918863:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408404736 00000100:00100000:1.0:1789181403.918873:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408403840 00000100:00100000:1.0:1789181403.918875:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408403840 00000100:00100000:1.0:1789181403.918886:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789181403.918892:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408404096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918925:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408404096:12345-0@lo:400:kworker.0 Request processed in 33us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.918931:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789181403.918941:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789181403.918947:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408404608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.918972:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408404608:12345-0@lo:400:kworker.0 Request processed in 26us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.918977:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789181403.918987:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789181403.918993:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408403712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.919025:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408403712:12345-0@lo:400:kworker.0 Request processed in 32us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.919031:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789181403.919050:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789181403.919056:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408404224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.919085:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408404224:12345-0@lo:400:kworker.0 Request processed in 30us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.919091:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789181403.919101:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789181403.919106:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408404736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.919132:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408404736:12345-0@lo:400:kworker.0 Request processed in 26us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.919137:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789181403.919147:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789181403.919152:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408403840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.919175:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408403840:12345-0@lo:400:kworker.0 Request processed in 23us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.919181:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789181403.919198:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408403456 00000100:00100000:1.0:1789181403.919202:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408403456 00000100:00100000:1.0:1789181403.919228:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789181403.919235:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408403456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181403.919255:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181403.919286:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408403456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.919292:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789181403.919342:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408403968 00000100:00100000:1.0:1789181403.919346:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408403968 00000100:00100000:1.0:1789181403.919373:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789181403.919386:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408403968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.919419:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408403968:12345-0@lo:400:kworker.0 Request processed in 33us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.919424:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789181403.919442:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408404480 00000100:00100000:0.0:1789181403.919776:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408404992 00000100:00100000:0.0:1789181403.919781:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408404992 00000100:00100000:0.0:1789181403.919804:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408404352 00000100:00100000:0.0:1789181403.919807:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408404352 00000100:00100000:0.0:1789181403.919816:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408404864 00000100:00100000:0.0:1789181403.919818:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408404864 00000100:00100000:0.0:1789181403.919831:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789181403.919838:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408404992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.919875:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408404992:12345-0@lo:400:kworker.0 Request processed in 37us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181403.919880:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789181403.919893:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789181403.919898:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408404352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.919924:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408404352:12345-0@lo:400:kworker.0 Request processed in 26us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181403.919929:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789181403.919940:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789181403.919953:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408404864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.919982:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408404864:12345-0@lo:400:kworker.0 Request processed in 31us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181403.919988:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789181403.920038:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181403.920043:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789181403.920045:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181403.920079:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408403840:0@lo:400:kworker.0 00010000:00080000:0.0:1789181403.920093:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb2a8a80 x1876092408404352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181403.920103:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408404352:0@lo:400:kworker.0 00010000:00080000:0.0:1789181403.920114:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3208e00 x1876092408404864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181403.920121:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408404864:0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.920131:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408403712:0@lo:400:kworker.0 00010000:00080000:0.0:1789181403.920139:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3878380 x1876092408404224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181403.920146:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408404224:0@lo:400:kworker.0 00010000:00080000:0.0:1789181403.920169:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3208380 x1876092408404736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181403.920176:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408404736:0@lo:400:kworker.0 00010000:00080000:0.0:1789181403.920218:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbd180 x1876092408403456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181403.920245:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408403456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181403.920259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408403968:0@lo:400:kworker.0 00010000:00080000:0.0:1789181403.920269:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc320ad80 x1876092408404992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181403.920277:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408404992:0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.920285:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408403584:0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.920296:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408404096:0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.920306:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408404608:0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.920777:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181403.920789:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408405120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181403.920842:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181403.920881:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408405120 00000100:00100000:0.0:1789181403.920885:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408405120 00000100:00100000:0.0:1789181403.920912:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789181403.920919:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408405120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181403.920931:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181403.920965:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408405120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181403.920971:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789181403.920997:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc37c4a80 x1876092408405120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181403.921009:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408405120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181403.923912:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408404480 00000100:00100000:1.0:1789181403.923970:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789181403.923980:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408404480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.924131:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408404480:12345-0@lo:400:kworker.0 Request processed in 152us (5926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.924139:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1789181403.934459:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc35f8000 x1876092408404480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181403.934479:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408404480:0@lo:400:kworker.0 10000000:01000000:0.0:1789181404.110758:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789181404.110766:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1cc2475000 from 7 10000000:01000000:0.0:1789181404.110770:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789181404.110825:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181404.110837:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181404.110848:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181404.110873:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181404.110940:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181404.110987:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6880a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181404.111049:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408405248 00000100:00100000:2.0:1789181404.111057:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408405248 00000100:00100000:2.0:1789181404.111119:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789181404.111128:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408405248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181404.111141:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181404.111154:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0084b000/0x76fb5552835170eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835170e4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.111176:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0084b000/0x76fb5552835170eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835170e4 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.111187:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0084b000/0x76fb5552835170eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835170e4 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.111196:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b000, rc 0) 00000100:00100000:2.0:1789181404.111232:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408405248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181404.111239:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789181404.111430:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181404.111456:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181404.111464:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181404.111517:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181404.111544:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181404.111570:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6880a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181404.111754:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408405376 00000100:00100000:2.0:1789181404.111760:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408405376 00000100:00100000:2.0:1789181404.111786:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789181404.111793:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408405376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.111904:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408405376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181404.111910:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789181404.111988:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181404.112014:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181404.112066:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181404.112107:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6880a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181404.112240:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408405504 00000100:00100000:2.0:1789181404.112251:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408405504 00000100:00100000:2.0:1789181404.112290:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789181404.112297:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408405504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.112389:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408405504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181404.112396:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789181404.113258:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789181404.115630:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789181404.115837:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789181404.115866:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181404.115877:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.115891:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181404.115901:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181404.115904:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dfb02c800 from 7 10000000:01000000:2.0:1789181404.115907:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181404.115946:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.115954:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.115965:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181404.115991:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.116061:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181404.116375:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34dae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181404.117546:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408405632 00000100:00100000:0.0:1789181404.117559:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408405632 00000100:00100000:0.0:1789181404.117611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789181404.117621:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408405632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181404.117637:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181404.117652:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658a400/0x76fb5552835170f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835170f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181404.117680:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658a400/0x76fb5552835170f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835170f2 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181404.117692:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658a400/0x76fb5552835170f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835170f2 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181404.117700:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658a400, rc 0) 00000100:00100000:0.0:1789181404.117779:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408405632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181404.117786:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789181404.118360:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181404.118386:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.118396:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181404.118955:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.119001:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181404.119038:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34dae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181404.120811:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408405760 00000100:00100000:0.0:1789181404.120828:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408405760 00000100:00100000:0.0:1789181404.120884:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789181404.120894:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408405760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181404.121048:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408405760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181404.123400:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789181404.123631:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181404.123703:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181404.123812:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181404.123861:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6880000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181404.124862:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408405888 00000100:00100000:3.0:1789181404.124874:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408405888 00000100:00100000:3.0:1789181404.124931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789181404.124941:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408405888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181404.125095:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408405888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181404.125102:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789181404.125643:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408405888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789181404.129134:0:13217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789181404.134043:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789181404.134103:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181404.134116:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.134130:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181404.134143:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181404.134146:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1df1a64800 from 7 10000000:01000000:2.0:1789181404.134148:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181404.134194:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.134201:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.134213:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181404.134259:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.134350:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181404.134401:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34da900 going to sleep for 11 seconds 00000100:00100000:3.0:1789181404.134755:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408406016 00000100:00100000:3.0:1789181404.134763:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408406016 00000100:00100000:3.0:1789181404.134812:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789181404.134821:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408406016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181404.134835:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181404.134848:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085e000/0x76fb555283517107 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283517100 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181404.134869:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085e000/0x76fb555283517107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283517100 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181404.134888:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085e000/0x76fb555283517107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517100 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181404.134896:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e000, rc 0) 00000100:00100000:3.0:1789181404.134942:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408406016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181404.134949:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789181404.135063:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34f8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181404.135090:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181404.135099:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181404.135160:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181404.135189:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181404.135213:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc26e4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181404.135881:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408406144 00000100:00100000:2.0:1789181404.135888:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408406144 00000100:00100000:2.0:1789181404.135920:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789181404.135928:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408406144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.136237:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408406144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181404.136245:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789181404.136287:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.136338:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.136382:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181404.136408:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34dae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181404.136419:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408406272 00000100:00100000:2.0:1789181404.136423:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408406272 00000100:00100000:2.0:1789181404.136440:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789181404.136446:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408406272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.136520:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408406272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181404.136526:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789181404.136562:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789181404.138707:0:13218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789181404.138840:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789181404.138881:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181404.138891:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.138904:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181404.138914:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181404.138916:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dc32aa000 from 7 10000000:01000000:2.0:1789181404.138919:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181404.138969:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.138976:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.138987:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181404.139010:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.139085:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181404.139125:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34dad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181404.139517:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408406400 00000100:00100000:3.0:1789181404.139527:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408406400 00000100:00100000:3.0:1789181404.139583:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789181404.139593:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408406400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181404.139607:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181404.139621:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085f400/0x76fb555283517115 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351710e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181404.139652:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085f400/0x76fb555283517115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351710e expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181404.139664:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085f400/0x76fb555283517115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351710e expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181404.139673:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f400, rc 0) 00000100:00100000:3.0:1789181404.139761:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408406400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181404.139768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789181404.139982:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181404.140000:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.140010:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181404.140523:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.140574:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181404.140612:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181404.140683:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408406528 00000100:00100000:1.0:1789181404.140689:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408406528 00000100:00100000:1.0:1789181404.140764:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789181404.140774:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408406528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181404.140892:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408406528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181404.140907:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789181404.140987:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.141018:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181404.141055:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181404.141182:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408406656 00000100:00100000:3.0:1789181404.141186:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408406656 00000100:00100000:3.0:1789181404.141224:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789181404.141231:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408406656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181404.151604:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181404.151639:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385250176 00000100:00100000:3.0:1789181404.151650:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385250176 00000100:00100000:3.0:1789181404.151712:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 329 00000100:00100000:3.0:1789181404.151740:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+11:6170:x1876092385250176:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181404.151758:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181404.151775:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085fe00/0x76fb55528351711c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e5e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181404.151805:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085fe00/0x76fb55528351711c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e5e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181404.151816:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085fe00/0x76fb55528351711c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e5e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181404.151826:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fe00, rc 0) 00000100:00100000:3.0:1789181404.151882:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385250176:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 161us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181404.151889:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 329 00000100:00100000:3.0:1789181404.152045:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408406656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 10813us (10988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181404.152052:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789181404.153168:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc34dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181404.153201:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408406656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789181404.155571:0:13219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789181404.155673:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 00000100:00100000:3.0:1789181404.156011:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181404.156042:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385250304 00000100:00100000:3.0:1789181404.156051:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385250304 00000100:00100000:3.0:1789181404.156096:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 330 00000100:00100000:3.0:1789181404.156122:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385250304:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181404.156267:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385250304:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 147us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181404.156275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 330 10000000:01000000:2.0:1789181404.157834:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181404.157851:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181404.157866:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181404.159505:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181404.159681:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385250432 00000100:00100000:3.0:1789181404.159703:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385250432 00000100:00100000:3.0:1789181404.159768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 331 00000100:00100000:3.0:1789181404.159778:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385250432:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181404.159915:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385250432:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 138us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181404.159923:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 331 00000100:00100000:3.0:1789181404.166403:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181404.166852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385250560 00000100:00100000:0.0:1789181404.166863:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385250560 00000100:00100000:0.0:1789181404.166923:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 332 00000100:00100000:0.0:1789181404.166933:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385250560:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181404.166951:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181404.166969:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658ac00/0x76fb555283517123 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181404.166997:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658ac00/0x76fb555283517123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e65 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181404.167007:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658ac00/0x76fb555283517123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e65 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181404.167016:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658ac00, rc 0) 00000100:00100000:0.0:1789181404.167153:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:6170:x1876092385250560:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 220us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181404.167161:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 332 00000100:00100000:2.0:1789181404.172406:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181404.172548:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385250688 00000100:00100000:3.0:1789181404.172557:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385250688 00000100:00100000:3.0:1789181404.172616:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 333 00000100:00100000:3.0:1789181404.172627:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:6170:x1876092385250688:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181404.172817:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:6170:x1876092385250688:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 191us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181404.172824:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 333 00000100:00100000:0.0:1789181404.178225:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181404.179596:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385250816 00000100:00100000:3.0:1789181404.179612:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385250816 00000100:00100000:3.0:1789181404.179702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 334 00000100:00100000:3.0:1789181404.179714:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:6170:x1876092385250816:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181404.179906:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:6170:x1876092385250816:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 194us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181404.179922:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 334 00010000:00010000:0.0:1789181404.688491:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181405.712286:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181405.980908:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408406784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181405.981006:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181405.981179:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408406784 00000100:00100000:1.0:1789181405.981188:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408406784 00000100:00100000:1.0:1789181405.981231:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789181405.981240:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408406784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181405.981275:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181405.981332:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408406784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181405.981338:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789181405.981384:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408406784:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789181406.737169:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181407.503069:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408406912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181407.503159:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181407.503255:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408406912 00000100:00100000:0.0:1789181407.503264:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408406912 00000100:00100000:0.0:1789181407.503324:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789181407.503333:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408406912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181407.503360:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181407.503402:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408406912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181407.503410:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1789181407.503430:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181407.503458:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc35f8000 x1876092408406912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181407.503477:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408406912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181407.503806:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181407.503816:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408407040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181407.503849:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181407.505766:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408407040 00000100:00100000:0.0:1789181407.505780:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408407040 00000100:00100000:0.0:1789181407.505842:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789181407.505850:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408407040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181407.505874:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181407.505938:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408407040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (2088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181407.505944:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1789181407.505983:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4302d80 x1876092408407040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181407.506001:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408407040:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789181407.506097:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181407.591080:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181407.591144:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181407.591172:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181407.591194:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181407.591217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181407.591338:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385250944 00000100:00100000:3.0:1789181407.591347:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385250944 00000100:00100000:3.0:1789181407.591398:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 335 00000100:00100000:3.0:1789181407.591408:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385250944:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181407.591497:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385251072 00000100:00100000:0.0:1789181407.591501:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385251072 00000100:00100000:2.0:1789181407.592747:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385251328 00000100:00100000:2.0:1789181407.592759:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385251328 00000100:00100000:3.0:1789181407.592829:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385250944:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1418us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181407.592841:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 335 00000100:00100000:0.0:1789181407.596749:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385251200 00000100:00100000:0.0:1789181407.596765:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385251200 00000100:00100000:3.0:1789181407.598557:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385251456 00000100:00100000:3.0:1789181407.598830:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385251456 00000100:00100000:2.0:1789181407.598959:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:2.0:1789181407.598971:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385251072:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181407.599086:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385251072:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 117us (8015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181407.599095:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:2.0:1789181407.599117:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:2.0:1789181407.599125:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385251328:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181407.599164:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385251328:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (7991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181407.599171:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00080000:2.0:1789181407.602826:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181407.602837:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181407.604695:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:0.0:1789181407.604714:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385251200:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181407.604815:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385251200:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 108us (13618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181407.604822:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:2.0:1789181407.607799:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:2.0:1789181407.607825:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385251456:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181407.607904:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385251456:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 91us (16684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181407.607913:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00010000:00010000:0.0:1789181407.757356:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789181408.385569:0:13390:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789181408.525202:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181408.525235:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408407168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181408.525316:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181408.525407:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408407168 00000100:00100000:3.0:1789181408.525416:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408407168 00000100:00100000:3.0:1789181408.525464:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789181408.525474:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408407168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181408.525511:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789181408.525566:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408407168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181408.525573:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789181408.525598:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408407168:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789181408.781545:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181409.036008:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408407680:0@lo:400:kworker.0 00000100:00100000:1.0:1789181409.036092:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181409.036148:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408408192:0@lo:400:kworker.0 00000100:00100000:1.0:1789181409.036173:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181409.036189:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408408704:0@lo:400:kworker.0 00000100:00100000:1.0:1789181409.036208:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181409.036231:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789181409.036236:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408407552:0@lo:400:kworker.0 00000100:00100000:1.0:1789181409.036256:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181409.036306:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408408064:0@lo:400:kworker.0 00000100:00100000:1.0:1789181409.036327:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181409.036341:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408408576:0@lo:400:kworker.0 00000100:00100000:1.0:1789181409.036370:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181409.036401:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408407552 00000100:00100000:1.0:1789181409.036408:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408407552 00000100:00100000:1.0:1789181409.036447:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789181409.036456:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408407552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181409.036506:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408407552:12345-0@lo:400:kworker.0 Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181409.036512:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789181409.036548:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408407552:0@lo:400:kworker.0 00000100:00100000:3.0:1789181409.036810:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408407680 00000100:00100000:3.0:1789181409.036815:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408407680 00000100:00100000:3.0:1789181409.036849:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408408064 00000100:00100000:3.0:1789181409.036851:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408408064 00000100:00100000:3.0:1789181409.036871:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408408576 00000100:00100000:3.0:1789181409.036874:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408408576 00000100:00100000:3.0:1789181409.036889:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789181409.036895:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408407680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181409.036934:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408407680:12345-0@lo:400:kworker.0 Request processed in 40us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181409.036940:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789181409.036952:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789181409.036959:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408408064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181409.036986:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408408064:12345-0@lo:400:kworker.0 Request processed in 28us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181409.036991:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789181409.037002:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789181409.037007:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408408576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181409.037030:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408408576:12345-0@lo:400:kworker.0 Request processed in 24us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181409.037035:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00080000:1.0:1789181409.037179:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff8fdc00 x1876092408408064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181409.037191:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408408064:0@lo:400:kworker.0 00010000:00080000:1.0:1789181409.037200:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff8fd180 x1876092408408576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181409.037208:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408408576:0@lo:400:kworker.0 00000100:00100000:1.0:1789181409.037217:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408407680:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.037383:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408407296:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.037416:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181409.037441:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408407808:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.037464:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181409.037479:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408408320:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.037496:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181409.037510:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408408832:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.037541:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181409.037559:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789181409.037564:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408407424:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.037582:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181409.037606:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408407936:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.037625:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181409.037653:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408408448:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.037672:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181409.037692:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408408192 00000100:00100000:0.0:1789181409.037696:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408408192 00000100:00100000:0.0:1789181409.037720:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408408704 00000100:00100000:0.0:1789181409.037741:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408408704 00000100:00100000:0.0:1789181409.037755:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408408320 00000100:00100000:0.0:1789181409.037757:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408408320 00000100:00100000:0.0:1789181409.037768:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408408832 00000100:00100000:0.0:1789181409.037770:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408408832 00000100:00100000:0.0:1789181409.037781:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789181409.037787:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408408192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.037823:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408408192:12345-0@lo:400:kworker.0 Request processed in 36us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181409.037829:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789181409.037841:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789181409.037846:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408408704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.037868:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408408704:12345-0@lo:400:kworker.0 Request processed in 23us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181409.037873:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789181409.037881:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789181409.037885:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408408320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.038094:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408408320:12345-0@lo:400:kworker.0 Request processed in 208us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181409.038101:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789181409.038120:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789181409.038126:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408408832:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789181409.038229:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff8fce00 x1876092408408192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181409.038240:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408408192:0@lo:400:kworker.0 00010000:00080000:1.0:1789181409.038250:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff8fd500 x1876092408408704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181409.038259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408408704:0@lo:400:kworker.0 00000100:00100000:1.0:1789181409.038283:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181409.038296:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408409088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181409.038333:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181409.038359:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408409088 00000100:00100000:1.0:1789181409.038363:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408409088 00000100:00100000:1.0:1789181409.038388:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789181409.038394:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408409088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181409.038415:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181409.038449:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408409088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181409.038454:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1789181409.038481:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff8fd180 x1876092408409088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181409.038495:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408409088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181409.038530:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408407296 00000100:00100000:1.0:1789181409.038533:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408407296 00000100:00100000:1.0:1789181409.038556:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789181409.038562:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408407296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181409.038671:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408408960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181409.038701:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181409.038747:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408407424 00000100:00100000:2.0:1789181409.038751:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408407424 00000100:00100000:2.0:1789181409.038772:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408407936 00000100:00100000:2.0:1789181409.038774:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408407936 00000100:00100000:2.0:1789181409.038786:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408408448 00000100:00100000:2.0:1789181409.038789:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408408448 00000100:00100000:2.0:1789181409.038801:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789181409.038807:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408407424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181409.046591:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408407808 00000100:00100000:3.0:1789181409.046608:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408407808 00000100:00100000:3.0:1789181409.046764:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789181409.046775:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408407808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181409.046875:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408407808:12345-0@lo:400:kworker.0 Request processed in 103us (9410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181409.046899:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789181409.047040:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408408832:12345-0@lo:400:kworker.0 Request processed in 8911us (9494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181409.047052:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789181409.047101:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789181409.047112:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408407936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.047151:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408407936:12345-0@lo:400:kworker.0 Request processed in 42us (9525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181409.047157:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789181409.047172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789181409.047179:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408408448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.047210:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408408448:12345-0@lo:400:kworker.0 Request processed in 33us (9538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181409.047216:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:3.0:1789181409.047405:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181409.047412:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181409.047414:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181409.047417:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181409.047433:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408408960 00000100:00100000:3.0:1789181409.047438:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408408960 00000100:00100000:3.0:1789181409.047464:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789181409.047471:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408408960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181409.047487:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181409.047525:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408408960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (8824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181409.047530:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1789181409.047575:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4301f80 x1876092408408960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181409.047596:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408408960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181409.048037:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408407296:12345-0@lo:400:kworker.0 Request processed in 9458us (10604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181409.048047:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789181409.060283:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408407424:12345-0@lo:400:kworker.0 Request processed in 21450us (22672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181409.060299:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789181409.069773:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408407424:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.069794:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408407936:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.069805:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408408448:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.069814:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408407296:0@lo:400:kworker.0 00000100:00100000:0.0:1789181409.069825:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408407808:0@lo:400:kworker.0 00010000:00080000:0.0:1789181409.069838:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff8ff800 x1876092408408320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181409.069848:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408408320:0@lo:400:kworker.0 00010000:00080000:0.0:1789181409.069882:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff8fca80 x1876092408408832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181409.069891:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408408832:0@lo:400:kworker.0 00010000:00010000:2.0:1789181409.804339:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181410.836983:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181411.084127:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408409216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789181411.084204:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181411.084363:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408409216 00000100:00100000:0.0:1789181411.084371:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408409216 00000100:00100000:0.0:1789181411.084431:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789181411.084441:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408409216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789181411.084485:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789181411.084541:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408409216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181411.084548:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789181411.085141:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408409216:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789181411.851947:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181412.633427:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408409344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181412.633502:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181412.633569:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408409344 00000100:00100000:0.0:1789181412.633576:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408409344 00000100:00100000:0.0:1789181412.633628:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789181412.633637:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408409344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181412.633667:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181412.633710:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408409344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181412.633717:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1789181412.633755:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181412.633782:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbe680 x1876092408409344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181412.633799:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408409344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181412.637041:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408409472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181412.637138:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181412.637271:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408409472 00000100:00100000:2.0:1789181412.637282:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408409472 00000100:00100000:2.0:1789181412.637345:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789181412.637356:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408409472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789181412.637380:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181412.637426:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408409472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181412.637432:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1789181412.637715:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181412.637772:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc34fb800 x1876092408409472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181412.637794:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408409472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181412.718794:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181412.718829:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181412.718910:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181412.718934:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181412.726316:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181412.731216:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385251712 00000100:00100000:2.0:1789181412.731241:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385251712 00000100:00100000:2.0:1789181412.731316:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385251968 00000100:00100000:2.0:1789181412.731319:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385251968 00000100:00100000:2.0:1789181412.731333:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385251840 00000100:00100000:2.0:1789181412.731335:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385251840 00000100:00100000:2.0:1789181412.731354:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:2.0:1789181412.731364:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385251712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181412.731449:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385251712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 86us (12733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181412.731456:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:2.0:1789181412.731492:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:2.0:1789181412.731499:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385251968:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181412.731524:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385251968:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (12695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181412.731544:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:2.0:1789181412.731556:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:2.0:1789181412.731563:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385251840:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181412.731589:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385251840:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (12654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181412.731594:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00080000:2.0:1789181412.733664:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181412.733675:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181412.734595:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385252096 00000100:00100000:2.0:1789181412.734609:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385252096 00000100:00100000:2.0:1789181412.734691:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:2.0:1789181412.734702:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385252096:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181412.734796:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385252096:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 95us (8489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181412.734803:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:2.0:1789181412.734830:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385251584 00000100:00100000:2.0:1789181412.734833:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385251584 00000100:00100000:2.0:1789181412.734859:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 337 00000100:00100000:2.0:1789181412.734865:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385251584:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181412.734890:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385251584:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (15980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181412.734896:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 337 00000100:00080000:1.0:1789181412.735620:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789181412.875939:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181413.646269:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408409600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181413.646356:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181413.646460:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408409600 00000100:00100000:3.0:1789181413.646470:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408409600 00000100:00100000:3.0:1789181413.646522:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789181413.646532:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408409600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181413.646568:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789181413.647313:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408409600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 779us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181413.647322:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789181413.647480:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408409600:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789181413.901997:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181414.155897:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408409728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181414.155960:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181414.156011:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408409856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181414.156032:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181414.156071:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408409728 00000100:00100000:2.0:1789181414.156078:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408409728 00000100:00100000:2.0:1789181414.156122:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408409856 00000100:00100000:2.0:1789181414.156124:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408409856 00000100:00100000:2.0:1789181414.156140:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789181414.156149:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408409728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789181414.156177:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181414.156240:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408409728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181414.156247:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789181414.156263:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1789181414.156267:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3977100 x1876092408409728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181414.156268:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408409856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181414.156277:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181414.156287:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408409728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181414.156299:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408409856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (266us total) trans 0 rc 0/0 00010000:00080000:0.0:1789181414.156299:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff8fdf80 x1876092408409856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181414.156305:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789181414.156310:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408409856:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789181414.156320:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181414.161563:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408410112:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.161636:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.161682:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408410624:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.161707:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.161744:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408411136:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.161762:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.161786:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789181414.161790:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408409984:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.161816:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.161835:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408410496:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.161851:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.161863:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408411008:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.161880:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.161904:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408410112 00000100:00100000:1.0:1789181414.161910:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408410112 00000100:00100000:1.0:1789181414.161943:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408410624 00000100:00100000:1.0:1789181414.161944:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408410624 00000100:00100000:1.0:1789181414.161960:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408411136 00000100:00100000:1.0:1789181414.161962:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408411136 00000100:00100000:1.0:1789181414.161975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789181414.161983:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408410112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162030:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408410112:12345-0@lo:400:kworker.0 Request processed in 48us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.162044:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789181414.162058:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789181414.162062:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408410624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162085:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408410624:12345-0@lo:400:kworker.0 Request processed in 23us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.162089:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789181414.162096:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789181414.162102:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408411136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162127:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408411136:12345-0@lo:400:kworker.0 Request processed in 25us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.162133:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789181414.162159:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408409984 00000100:00100000:1.0:1789181414.162162:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408409984 00000100:00100000:1.0:1789181414.162184:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789181414.162188:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408409984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162208:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408409984:12345-0@lo:400:kworker.0 Request processed in 21us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.162212:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789181414.162259:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408410496 00000100:00100000:1.0:1789181414.162262:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408410496 00000100:00100000:1.0:1789181414.162286:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789181414.162292:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408410496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162328:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408410496:12345-0@lo:400:kworker.0 Request processed in 36us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.162334:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789181414.162359:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408411008 00000100:00100000:1.0:1789181414.162362:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408411008 00000100:00100000:1.0:1789181414.162388:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789181414.162393:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408411008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162415:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408411008:12345-0@lo:400:kworker.0 Request processed in 23us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.162419:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789181414.162443:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408410240:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162462:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.162482:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408410752:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162494:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.162503:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408411264:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162515:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.162525:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789181414.162529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408410368:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162541:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.162549:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408410880:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162562:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181414.162582:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408410880 00000100:00100000:1.0:1789181414.162584:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408410880 00000100:00100000:1.0:1789181414.162605:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789181414.162610:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408410880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162633:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408410880:12345-0@lo:400:kworker.0 Request processed in 24us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.162638:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789181414.162657:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408410752 00000100:00100000:1.0:1789181414.162667:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408410752 00000100:00100000:1.0:1789181414.162694:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408411264 00000100:00100000:1.0:1789181414.162697:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408411264 00000100:00100000:1.0:1789181414.162713:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408410368 00000100:00100000:1.0:1789181414.162715:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408410368 00000100:00100000:1.0:1789181414.162738:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789181414.162743:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408410752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162766:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408410752:12345-0@lo:400:kworker.0 Request processed in 24us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.162770:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789181414.162778:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789181414.162782:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408411264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162800:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408411264:12345-0@lo:400:kworker.0 Request processed in 18us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.162803:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789181414.162809:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789181414.162811:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408410368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162825:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408410368:12345-0@lo:400:kworker.0 Request processed in 13us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.162828:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:1.0:1789181414.162843:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181414.162847:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181414.162849:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181414.162870:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408410368:0@lo:400:kworker.0 00010000:00080000:1.0:1789181414.162881:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3894700 x1876092408410880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181414.162888:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408410880:0@lo:400:kworker.0 00010000:00080000:1.0:1789181414.162902:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3897100 x1876092408410752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181414.162908:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408410752:0@lo:400:kworker.0 00010000:00080000:1.0:1789181414.162916:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3897480 x1876092408411264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181414.162920:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408411264:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162949:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408409984:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162957:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408410496:0@lo:400:kworker.0 00010000:00080000:1.0:1789181414.162965:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3897b80 x1876092408411008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181414.162971:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408411008:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162979:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408410112:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162988:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408410624:0@lo:400:kworker.0 00000100:00100000:1.0:1789181414.162995:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408411136:0@lo:400:kworker.0 00000100:00100000:2.0:1789181414.165633:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408410240 00000100:00100000:2.0:1789181414.165647:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408410240 00000100:00100000:2.0:1789181414.165700:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789181414.165707:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408410240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181414.165840:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408410240:12345-0@lo:400:kworker.0 Request processed in 133us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181414.165850:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789181414.165968:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408410240:0@lo:400:kworker.0 00000001:02000400:3.0:1789181414.570576:0:13539:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:50:12 (1789181412) === 00000100:00100000:2.0:1789181414.821876:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181414.821927:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181414.822030:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385252224 00000100:00100000:1.0:1789181414.822041:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385252224 00000100:00100000:1.0:1789181414.822128:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1789181414.822139:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2396:x1876092385252224:12345-192.168.202.1@tcp:41:mkdir.0 00000100:00080000:0.0:1789181414.822162:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789181414.822182:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789181414.822291:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2396:x1876092385252224:12345-192.168.202.1@tcp:41:mkdir.0 Request processed in 153us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.822315:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1789181414.824867:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385252352 00000100:00100000:2.0:1789181414.824884:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385252352 00000100:00100000:2.0:1789181414.824944:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1789181414.824956:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:10499:x1876092385252352:12345-192.168.202.1@tcp:700:mkdir.0 00000100:00100000:2.0:1789181414.825297:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:10499:x1876092385252352:12345-192.168.202.1@tcp:700:mkdir.0 Request processed in 342us (3368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181414.825306:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1789181414.827963:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181414.828097:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385252608 00000100:00100000:1.0:1789181414.828108:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385252608 00000100:00100000:1.0:1789181414.828169:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1789181414.828179:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:10499:x1876092385252608:12345-192.168.202.1@tcp:36:mkdir.0 00010000:00010000:1.0:1789181414.828252:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181414.828332:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283516fcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7dd9 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.828431:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc3740800) 00010000:00010000:1.0:1789181414.828443:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181414.828654:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351712a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.828668:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351712a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.828677:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351712a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.828701:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.828708:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.828715:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829641:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829660:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829669:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181414.829685:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b853dd92 reply state 000000000afdce00 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829695:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829701:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dc3dc5900) 00010000:00010000:1.0:1789181414.829704:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789181414.829708:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789181414.829713:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789181414.829720:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351712a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829750:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351712a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829757:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351712a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829763:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181414.829767:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351712a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829774:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351712a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829794:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3dc5c00) 00010000:00010000:1.0:1789181414.829796:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181414.829800:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351712a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829806:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351712a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181414.829821:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b853dd92 reply state 000000000afdce00 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829829:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.829835:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c1dc3dc5a00) 00010000:00010000:1.0:1789181414.829837:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789181414.829839:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789181414.830034:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:10499:x1876092385252608:12345-192.168.202.1@tcp:36:mkdir.0 Request processed in 1853us (2079us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789181414.830042:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:0.0:1789181414.844436:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181414.844847:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385252736 00000100:00100000:1.0:1789181414.844858:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385252736 00000100:00100000:1.0:1789181414.844960:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1789181414.844980:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:10500:x1876092385252736:12345-192.168.202.1@tcp:101:chmod.0 00010000:00010000:1.0:1789181414.845002:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181414.845025:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351713f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e6c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.845094:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb555283517146 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.845121:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb555283517146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.845133:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb555283517146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181414.845176:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789181414.845180:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181414.845232:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb555283517146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.845261:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb55528351713f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e6c expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.845280:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb555283517146 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e6c expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.845290:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3dc5c00) 00010000:00010000:1.0:1789181414.845293:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181414.845297:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e021f0200, rc 0) 00000100:00100000:1.0:1789181414.845374:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:10500:x1876092385252736:12345-192.168.202.1@tcp:101:chmod.0 Request processed in 405us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.845382:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1789181414.848067:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181414.848330:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385252992 00000100:00100000:2.0:1789181414.848396:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385252992 00000100:00100000:3.0:1789181414.848652:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1789181414.848665:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:10500:x1876092385252992:12345-192.168.202.1@tcp:36:chmod.0 00010000:00010000:3.0:1789181414.848760:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181414.848787:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb555283517146 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e6c expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.848808:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3dc5c00) 00010000:00010000:3.0:1789181414.848829:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181414.848856:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.848869:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.848878:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181414.849288:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a8963b0 reply state 00000000323c293f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.849301:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.849308:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc3740300) 00010000:00010000:3.0:1789181414.849311:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789181414.849314:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789181414.849322:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789181414.849704:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:10500:x1876092385252992:12345-192.168.202.1@tcp:36:chmod.0 Request processed in 1040us (1648us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789181414.849766:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1789181414.873538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181414.873788:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385253120 00000100:00100000:2.0:1789181414.873799:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385253120 00000100:00100000:0.0:1789181414.874314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1789181414.874325:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:10501:x1876092385253120:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:0.0:1789181414.874352:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181414.874376:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283517154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e73 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181414.874497:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351715b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181414.874529:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351715b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181414.874581:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351715b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181414.874696:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789181414.874757:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181414.874872:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351715b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181414.874940:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283517154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e73 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181414.876175:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351715b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e73 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181414.876186:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc3740300) 00010000:00010000:0.0:1789181414.876189:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181414.876193:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b600, rc 0) 00000100:00100000:0.0:1789181414.876279:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:10501:x1876092385253120:12345-192.168.202.1@tcp:101:chown.0 Request processed in 1955us (2751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181414.876296:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1789181414.878231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181414.878345:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385253248 00000100:00100000:2.0:1789181414.878355:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385253248 00000100:00100000:2.0:1789181414.878415:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1789181414.878426:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:10501:x1876092385253248:12345-192.168.202.1@tcp:101:chown.0 00010000:00010000:2.0:1789181414.878447:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181414.878517:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e7a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.878585:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517169 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.878600:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517169 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.878614:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517169 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.878643:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517170 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.878651:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517170 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.878658:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517170 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.878890:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517177 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.878898:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.878916:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181414.879084:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789181414.879088:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181414.879110:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879122:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517169 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879128:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517169 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879134:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517169 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879148:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181414.879152:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517169 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879160:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517169 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879172:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc3740300) 00010000:00010000:2.0:1789181414.879175:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181414.879180:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517169 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879186:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517169 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879200:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517170 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879206:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517170 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879222:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517170 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879228:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181414.879231:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517170 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879236:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517170 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879255:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c1dc3dc5a00) 00010000:00010000:2.0:1789181414.879257:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181414.879260:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517170 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879265:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517170 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879294:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e7a expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879308:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e7a expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.879315:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dc3dc5900) 00010000:00010000:2.0:1789181414.879317:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181414.879319:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084bc00, rc 0) 00000100:00100000:2.0:1789181414.879417:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:10501:x1876092385253248:12345-192.168.202.1@tcp:101:chown.0 Request processed in 992us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181414.879424:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1789181414.882427:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181414.882557:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385253376 00000100:00100000:2.0:1789181414.882568:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385253376 00000100:00100000:2.0:1789181414.882635:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1789181414.882646:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:10501:x1876092385253376:12345-192.168.202.1@tcp:900:chown.0 00000100:00100000:2.0:1789181414.882861:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:10501:x1876092385253376:12345-192.168.202.1@tcp:900:chown.0 Request processed in 216us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181414.882869:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1789181414.885929:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181414.886068:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385253632 00000100:00100000:3.0:1789181414.886078:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385253632 00000100:00100000:3.0:1789181414.886138:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1789181414.886149:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:10501:x1876092385253632:12345-192.168.202.1@tcp:36:chown.0 00010000:00010000:3.0:1789181414.886208:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181414.886250:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517177 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e7a expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.886269:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dc3dc5900) 00010000:00010000:3.0:1789181414.886274:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181414.886297:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.886311:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.886319:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181414.889343:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1789181414.889438:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000532d894b reply state 000000005d370c6b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.889460:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.889479:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dc3dc5900) 00010000:00010000:3.0:1789181414.889482:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789181414.889497:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789181414.889508:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1789181414.889607:0:9021:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789181414.889661:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:10501:x1876092385253632:12345-192.168.202.1@tcp:36:chown.0 Request processed in 3510us (3737us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789181414.889670:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00010000:00010000:1.0:1789181414.897364:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.897385:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.897412:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.897419:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181414.897424:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.897433:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.897451:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dc3dc5900) 00010000:00010000:1.0:1789181414.897454:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789181414.897459:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.897620:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb55528351717e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900255:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900275:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900283:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900289:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f1600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181414.900294:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900302:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900318:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c1dc3dc5a00) 00010000:00010000:2.0:1789181414.900322:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181414.900327:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900586:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb555283517131 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900615:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900621:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900628:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900653:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f1200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181414.900656:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900663:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900673:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dc3dc5900) 00010000:00010000:2.0:1789181414.900675:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181414.900678:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900685:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb555283517138 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900702:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900708:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900714:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.900720:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fc00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181414.905187:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.905202:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.905252:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc3740300) 00010000:00010000:2.0:1789181414.905255:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789181414.905261:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181414.905268:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351714d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181414.913407:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181414.913497:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385253760 00000100:00100000:1.0:1789181414.913507:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385253760 00000100:00100000:1.0:1789181414.913565:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:1.0:1789181414.913575:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:10502:x1876092385253760:12345-192.168.202.1@tcp:101:touch.500 00010000:00010000:1.0:1789181414.913601:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181414.913621:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb555283517185 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e81 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789181414.914539:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 867us 00010000:00010000:2.0:1789181414.923907:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181414.936491:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1e00/0x76fb55528351718c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936530:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1e00/0x76fb55528351718c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936545:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1e00/0x76fb55528351718c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936564:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0000/0x76fb555283517193 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936572:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0000/0x76fb555283517193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936580:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0000/0x76fb555283517193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936716:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb55528351719a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936742:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb55528351719a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936749:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb55528351719a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181414.936782:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789181414.936786:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181414.936825:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb55528351719a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936837:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1e00/0x76fb55528351718c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936854:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1e00/0x76fb55528351718c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936861:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1e00/0x76fb55528351718c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936868:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f1e00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181414.936872:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1e00/0x76fb55528351718c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936880:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1e00/0x76fb55528351718c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.936895:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc3740300) 00010000:00010000:1.0:1789181414.938746:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181414.938764:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1e00/0x76fb55528351718c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.938775:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1e00/0x76fb55528351718c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.938794:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0000/0x76fb555283517193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.938801:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0000/0x76fb555283517193 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.938808:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0000/0x76fb555283517193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.938813:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181414.938830:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0000/0x76fb555283517193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.938837:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0000/0x76fb555283517193 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.938852:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c1dcf5c0100) 00010000:00010000:1.0:1789181414.938855:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181414.938859:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0000/0x76fb555283517193 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.938865:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0000/0x76fb555283517193 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.939429:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0400/0x76fb555283517185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e81 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.939449:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb55528351719a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e81 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.939459:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dcf5c0200) 00010000:00010000:1.0:1789181414.939462:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789181414.939465:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e021f1200, rc 0) 00000100:00100000:1.0:1789181414.939545:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:10502:x1876092385253760:12345-192.168.202.1@tcp:101:touch.500 Request processed in 25969us (26145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.939554:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1789181414.945265:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181414.945435:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385254016 00000100:00100000:1.0:1789181414.945448:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385254016 00000100:00100000:1.0:1789181414.945561:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1789181414.945573:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:10502:x1876092385254016:12345-192.168.202.1@tcp:101:touch.500 00010000:00010000:1.0:1789181414.945603:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181414.945624:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb5552835171a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e88 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.945770:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb5552835171a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.945787:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb5552835171a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.945799:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb5552835171a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.945869:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.945879:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.945887:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789181414.946306:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789181414.946448:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb5552835171b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946458:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb5552835171b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946466:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb5552835171b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946504:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb5552835171a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946511:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb5552835171a8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946518:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb5552835171a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946524:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181414.946528:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb5552835171a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946535:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb5552835171a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946547:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dcf5c0200) 00010000:00010000:1.0:1789181414.946549:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181414.946554:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb5552835171a8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946560:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f0200/0x76fb5552835171a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181414.946571:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050d6eb1b reply state 00000000b34b0665 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946580:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946586:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff9c1dcf5c0b00) 00010000:00010000:1.0:1789181414.946592:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789181414.946596:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789181414.946625:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1600/0x76fb5552835171a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e88 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946638:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb5552835171b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e88 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.946645:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c1dcf5c0900) 00010000:00010000:1.0:1789181414.946647:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181414.946649:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12c00, rc 0) 00000100:00100000:1.0:1789181414.946709:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:10502:x1876092385254016:12345-192.168.202.1@tcp:101:touch.500 Request processed in 1139us (1454us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789181414.946717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1789181414.950273:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181414.950475:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385254272 00000100:00100000:3.0:1789181414.950483:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385254272 00000100:00100000:3.0:1789181414.950540:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1789181414.950549:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:10502:x1876092385254272:12345-192.168.202.1@tcp:36:touch.500 00010000:00010000:3.0:1789181414.950602:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181414.950626:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb5552835171b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e88 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.950642:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c1dcf5c0900) 00010000:00010000:3.0:1789181414.950652:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181414.950703:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.950715:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.950747:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181414.950839:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4aee8ac reply state 0000000094df999c transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.950850:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.950872:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c1cc3740100) 00010000:00010000:3.0:1789181414.950875:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181414.950878:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181414.951136:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:10502:x1876092385254272:12345-192.168.202.1@tcp:36:touch.500 Request processed in 586us (870us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789181414.951144:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1789181414.953557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181414.953838:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385254400 00000100:00100000:3.0:1789181414.953848:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385254400 00000100:00100000:3.0:1789181414.953912:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:3.0:1789181414.953923:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:10502:x1876092385254400:12345-192.168.202.1@tcp:101:touch.500 00010000:00010000:3.0:1789181414.953948:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181414.953984:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835171cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e8f expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.954304:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835171cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e8f expref: 12 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.954321:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835171cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e8f expref: 12 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.954354:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c1cc3740100) 00010000:00010000:3.0:1789181414.954357:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181414.954361:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085ea00, rc 0) 00000100:00100000:3.0:1789181414.954427:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:10502:x1876092385254400:12345-192.168.202.1@tcp:101:touch.500 Request processed in 506us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181414.954435:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:0.0:1789181414.957930:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181414.959458:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385254528 00000100:00100000:2.0:1789181414.959474:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385254528 00000100:00100000:2.0:1789181414.959528:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1789181414.959538:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876092385254528:12345-192.168.202.1@tcp:8:touch.500 00010000:00080000:2.0:1789181414.959572:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:2.0:1789181414.959605:0:8435:0:(genops.c:1384:class_connect()) connect: client 3c4ab02e-ed68-4ee0-b458-d9073baffb59, cookie 0x76fb5552835171d2 00002000:00100000:2.0:1789181414.959616:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3c4ab02e-ed68-4ee0-b458-d9073baffb59/ffff9c1cc3a2c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789181414.959627:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789181414.959702:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789181414.959756:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c1cc3a2e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181414.959830:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2392:x1876092385254528:12345-192.168.202.1@tcp:8:touch.500 Request processed in 291us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181414.959838:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:0.0:1789181414.965949:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181414.966174:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385254656 00000100:00100000:1.0:1789181414.966185:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385254656 00000100:00100000:1.0:1789181414.966280:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1789181414.966291:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:0:x1876092385254656:12345-192.168.202.1@tcp:2:touch.500 00000100:00080000:0.0:1789181414.966564:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789181414.968386:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1789181414.968402:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000100:00100000:1.0:1789181414.968661:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:0:x1876092385254656:12345-192.168.202.1@tcp:2:touch.500 Request processed in 2367us (2716us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789181414.968673:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1789181414.972636:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181414.972769:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385254912 00000100:00100000:0.0:1789181414.972780:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385254912 00000100:00100000:0.0:1789181414.972838:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1789181414.972850:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:10502:x1876092385254912:12345-192.168.202.1@tcp:35:touch.500 00000100:00100000:0.0:1789181414.973340:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:10502:x1876092385254912:12345-192.168.202.1@tcp:35:touch.500 Request processed in 491us (713us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789181414.973349:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1789181414.985711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181414.985880:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385255040 00000100:00100000:1.0:1789181414.985891:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385255040 00000100:00100000:1.0:1789181414.985956:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1789181414.985966:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:10503:x1876092385255040:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:1.0:1789181414.986194:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181414.986225:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835171d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e96 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.986301:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835171e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.986317:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835171e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.986330:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835171e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181414.986382:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789181414.986385:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181414.986423:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835171e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.986448:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835171d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e96 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.986536:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835171e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e96 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181414.986547:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dcf5c0200) 00010000:00010000:1.0:1789181414.986550:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181414.986554:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13800, rc 0) 00000100:00100000:1.0:1789181414.986619:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:10503:x1876092385255040:12345-192.168.202.1@tcp:101:rm.0 Request processed in 654us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181414.986626:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1789181414.990340:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181414.990411:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385255296 00000100:00100000:3.0:1789181414.990421:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385255296 00000100:00100000:3.0:1789181414.990481:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1789181414.990490:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:10503:x1876092385255296:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:3.0:1789181414.990510:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181414.990529:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835171e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7e9d expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181414.990627:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789181414.990770:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835171e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e9d expref: 16 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.990784:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc3740300) 00010000:00010000:3.0:1789181414.990786:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181414.990791:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835171e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e9d expref: 16 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181414.990805:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e200, rc 0) 00000100:00100000:3.0:1789181414.990858:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:10503:x1876092385255296:12345-192.168.202.1@tcp:101:rm.0 Request processed in 368us (525us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1789181414.990864:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1789181414.996499:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181414.996675:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385255424 00000100:00100000:0.0:1789181414.996686:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385255424 00000100:00100000:0.0:1789181414.996784:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1789181414.996797:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:10503:x1876092385255424:12345-192.168.202.1@tcp:37:rm.0 00000100:00100000:1.0:1789181415.005428:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:10503:x1876092385255424:12345-192.168.202.1@tcp:37:rm.0 Request processed in 8622us (8926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181415.005456:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1789181415.009889:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181415.010163:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385255680 00000100:00100000:2.0:1789181415.010174:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385255680 00000100:00100000:2.0:1789181415.010245:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1789181415.010256:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd935bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:10503:x1876092385255680:12345-192.168.202.1@tcp:35:rm.0 00000100:00100000:2.0:1789181415.011226:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd935bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:10503:x1876092385255680:12345-192.168.202.1@tcp:35:rm.0 Request processed in 956us (1333us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789181415.011238:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1789181415.014280:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181415.014818:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385255936 00000100:00100000:2.0:1789181415.014829:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385255936 00000100:00100000:2.0:1789181415.015115:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:2.0:1789181415.015126:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:10503:x1876092385255936:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:2.0:1789181415.015153:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181415.015174:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835171f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7ea4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181415.015296:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb5552835171fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181415.015311:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb5552835171fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181415.015326:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb5552835171fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181415.015348:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789181415.015551:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835171f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ea4 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181415.015574:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb5552835171fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ea4 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181415.015585:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dcf5c0200) 00010000:00010000:2.0:1789181415.015596:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181415.015601:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b400, rc 0) 00000100:00100000:2.0:1789181415.015689:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:10503:x1876092385255936:12345-192.168.202.1@tcp:101:rm.0 Request processed in 564us (1419us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789181415.015699:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1789181415.018836:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181415.019455:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385256064 00000100:00100000:1.0:1789181415.019466:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385256064 00000100:00100000:2.0:1789181415.019544:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:2.0:1789181415.019556:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:10503:x1876092385256064:12345-192.168.202.1@tcp:41:rm.0 00000004:00000024:2.0:1789181415.019618:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789181415.019698:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:10503:x1876092385256064:12345-192.168.202.1@tcp:41:rm.0 Request processed in 144us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181415.019705:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1789181415.023298:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181415.023466:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385256192 00000100:00100000:3.0:1789181415.023476:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385256192 00000100:00100000:3.0:1789181415.023557:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:3.0:1789181415.023568:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:10503:x1876092385256192:12345-192.168.202.1@tcp:101:rm.0 00010000:00010000:3.0:1789181415.023591:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181415.023613:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb55528351720a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7eab expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023680:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517211 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023697:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517211 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023709:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517211 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023754:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517218 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023762:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023770:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023863:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351721f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023871:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351721f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023878:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351721f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181415.023933:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789181415.023938:0:9021:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181415.023957:0:9021:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351721f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023978:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351721f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023986:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517211 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023992:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517211 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.023998:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517211 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024004:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181415.024008:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517211 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024016:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517211 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024193:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dcf5c0200) 00010000:00010000:3.0:1789181415.024197:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181415.024203:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517211 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024220:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517211 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024244:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024250:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517218 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024255:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517218 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024260:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181415.024263:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517218 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024270:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517218 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024278:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff9c1dcf5c0b00) 00010000:00010000:3.0:1789181415.024280:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181415.024283:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517218 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024289:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517218 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024318:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb55528351720a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eab expref: 20 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024346:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351721f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eab expref: 19 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.024364:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c1cc3740100) 00010000:00010000:3.0:1789181415.024367:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181415.024369:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fc00, rc 0) 00000100:00100000:3.0:1789181415.024434:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:10503:x1876092385256192:12345-192.168.202.1@tcp:101:rm.0 Request processed in 868us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181415.024441:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1789181415.029106:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181415.029395:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385256448 00000100:00100000:1.0:1789181415.029405:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385256448 00000100:00100000:1.0:1789181415.029475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:1.0:1789181415.029487:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:10503:x1876092385256448:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:1.0:1789181415.029545:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789181415.029575:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351721f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eab expref: 19 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029598:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835171cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e8f expref: 18 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029614:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c1cc3740100) 00010000:00010000:1.0:1789181415.029626:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835171e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e96 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029635:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dcf5c0200) 00010000:00010000:1.0:1789181415.029638:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181415.029660:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517226 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029675:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517226 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029685:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517226 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029715:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029777:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029786:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029918:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb555283517234 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029927:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb555283517234 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.029934:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb555283517234 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181415.030367:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789181415.030379:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371017654441ns, next at 372017651543ns, rc = 0 00010000:00010000:1.0:1789181415.030438:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.030448:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.030456:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.030464:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.030481:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.030487:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181415.030673:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789181415.030998:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb555283517234 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031007:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb555283517234 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031013:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb555283517234 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031041:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12e00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181415.031045:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb555283517234 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031052:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb555283517234 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031064:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c1cc3740100) 00010000:00010000:0.0:1789181415.031067:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789181415.031070:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb555283517234 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031077:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb555283517234 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031094:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517226 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031100:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517226 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031106:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517226 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031111:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181415.031113:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517226 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031119:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517226 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031137:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dcf5c0200) 00010000:00010000:0.0:1789181415.031139:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181415.031142:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517226 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031148:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517226 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181415.031161:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b137cbd reply state 000000008e674eb4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031170:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181415.031175:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff9c1dcf5c0b00) 00010000:00010000:0.0:1789181415.031177:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181415.031180:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181415.031277:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:10503:x1876092385256448:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1789us (2177us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789181415.031286:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00010000:00010000:2.0:1789181415.032443:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181415.032456:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181415.032525:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12000 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181415.032529:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181415.032537:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181415.032551:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c1cc3740100) 00010000:00010000:2.0:1789181415.032554:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789181415.032556:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181415.032563:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351723b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181415.032595:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181415.032597:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181415.032599:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181415.036420:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181415.036502:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385256704 00000100:00100000:1.0:1789181415.036513:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385256704 00000100:00100000:1.0:1789181415.036572:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1789181415.036583:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:10503:x1876092385256704:12345-192.168.202.1@tcp:35:rm.0 00000100:00100000:1.0:1789181415.036828:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:10503:x1876092385256704:12345-192.168.202.1@tcp:35:rm.0 Request processed in 247us (418us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789181415.036836:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1789181415.040437:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181415.040625:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385256960 00000100:00100000:3.0:1789181415.040635:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385256960 00000100:00100000:3.0:1789181415.040692:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1789181415.040702:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:10503:x1876092385256960:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:3.0:1789181415.040790:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789181415.040818:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb5552835171fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ea4 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.040905:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e021f1200/0x76fb55528351719a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e81 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.040919:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1dcf5c0200) 00010000:00010000:3.0:1789181415.040936:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351715b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e73 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.040945:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc3740300) 00010000:00010000:3.0:1789181415.040951:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181415.040986:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517242 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041016:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517242 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041182:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517242 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041200:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041208:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041225:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041311:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517250 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041319:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517250 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041326:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517250 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181415.041605:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789181415.041621:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517250 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041630:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517250 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041637:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517250 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041651:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181415.041656:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517250 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041664:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517250 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041674:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c1cc3740800) 00010000:00010000:3.0:1789181415.041677:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789181415.041681:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517250 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041687:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517250 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041709:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517242 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.041715:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517242 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.042175:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517242 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.042184:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ec00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181415.042187:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517242 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.042194:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517242 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.042226:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc3740200) 00010000:00010000:3.0:1789181415.042228:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181415.042232:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517242 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.042237:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517242 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181415.042252:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5330eb1 reply state 00000000f7204044 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.042261:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181415.042267:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c1cc3740900) 00010000:00010000:3.0:1789181415.042269:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181415.042272:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181415.042372:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:10503:x1876092385256960:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1669us (1941us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789181415.042382:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00010000:00010000:2.0:1789181415.947870:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181416.219334:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408411392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789181416.219415:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181416.220155:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408411392 00000100:00100000:1.0:1789181416.220167:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408411392 00000100:00100000:1.0:1789181416.220236:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789181416.220247:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408411392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181416.220288:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181416.220370:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408411392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181416.220376:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789181416.220426:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408411392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789181416.978425:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181417.741061:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408411520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181417.741132:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181417.741217:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408411520 00000100:00100000:0.0:1789181417.741228:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408411520 00000100:00100000:0.0:1789181417.741283:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789181417.741294:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408411520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181417.741324:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181417.741381:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408411520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181417.741389:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1789181417.741410:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181417.741440:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093ed80 x1876092408411520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181417.741459:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408411520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181417.741659:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408411648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181417.741696:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181417.746106:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408411648 00000100:00100000:3.0:1789181417.746123:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408411648 00000100:00100000:3.0:1789181417.746222:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789181417.746234:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408411648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181417.746263:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181417.746354:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408411648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (4656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181417.746361:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1789181417.746450:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3955f80 x1876092408411648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181417.746471:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408411648:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181417.747079:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181417.847814:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181417.847863:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181417.847884:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181417.847904:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181417.847928:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181417.847954:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181417.847983:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385257344 00000100:00100000:0.0:1789181417.847993:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385257344 00000100:00100000:0.0:1789181417.848316:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385257600 00000100:00100000:0.0:1789181417.848321:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385257600 00000100:00100000:0.0:1789181417.848338:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385257216 00000100:00100000:0.0:1789181417.848340:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385257216 00000100:00100000:0.0:1789181417.848352:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385257728 00000100:00100000:0.0:1789181417.848354:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385257728 00000100:00100000:0.0:1789181417.848370:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:0.0:1789181417.848380:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385257344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181417.848522:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385257088 00000100:00100000:2.0:1789181417.848527:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385257088 00000100:00100000:2.0:1789181417.848576:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 339 00000100:00100000:2.0:1789181417.848583:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385257088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181417.848652:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385257088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 69us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181417.848660:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 339 00000100:00100000:0.0:1789181417.849309:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385257344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 925us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181417.849317:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:0.0:1789181417.849339:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:0.0:1789181417.849364:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385257600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181417.849395:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385257600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181417.849400:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:0.0:1789181417.849413:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:0.0:1789181417.849420:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:2394:x1876092385257216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181417.849447:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:2394:x1876092385257216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181417.849453:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:0.0:1789181417.849466:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:0.0:1789181417.849473:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385257728:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181417.849496:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385257728:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181417.849502:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:0.0:1789181417.849530:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385257472 00000100:00100000:0.0:1789181417.849535:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385257472 00000100:00100000:0.0:1789181417.849569:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1789181417.849576:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385257472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181417.849600:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385257472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181417.849606:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00080000:0.0:1789181417.857777:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181417.857785:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181417.857788:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789181417.997604:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181418.764942:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408411776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181418.765015:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181418.765151:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408411776 00000100:00100000:2.0:1789181418.765160:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408411776 00000100:00100000:2.0:1789181418.765223:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789181418.765232:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408411776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789181418.765277:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789181418.765334:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408411776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181418.765342:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789181418.765473:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408411776:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789181419.021781:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181419.277806:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408412160:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.277880:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181419.277949:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408412672:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.277975:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181419.277992:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408413184:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.278013:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181419.278042:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789181419.278049:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408412032:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.278068:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181419.278087:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408412544:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.278105:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181419.278121:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408413056:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.278139:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181419.278165:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408412160 00000100:00100000:1.0:1789181419.278183:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408412160 00000100:00100000:1.0:1789181419.278233:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789181419.278242:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408412160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181419.278476:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408412288:0@lo:400:kworker.0 00000100:00100000:3.0:1789181419.278535:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408411904:0@lo:400:kworker.0 00000100:00100000:0.0:1789181419.285427:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181419.285495:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408412800:0@lo:400:kworker.0 00000100:00100000:0.0:1789181419.285534:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181419.285569:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408413312:0@lo:400:kworker.0 00000100:00100000:0.0:1789181419.285591:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181419.285777:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181419.285808:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408412416:0@lo:400:kworker.0 00000100:00100000:3.0:1789181419.285832:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181419.285850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408412928:0@lo:400:kworker.0 00000100:00100000:3.0:1789181419.285870:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181419.285888:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408413440:0@lo:400:kworker.0 00000100:00100000:3.0:1789181419.285908:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181419.286404:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408412672 00000100:00100000:0.0:1789181419.286415:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408412672 00000100:00100000:0.0:1789181419.286464:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408413184 00000100:00100000:0.0:1789181419.286467:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408413184 00000100:00100000:0.0:1789181419.286479:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408412032 00000100:00100000:0.0:1789181419.286482:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408412032 00000100:00100000:0.0:1789181419.286493:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408412544 00000100:00100000:0.0:1789181419.286496:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408412544 00000100:00100000:0.0:1789181419.286507:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408413056 00000100:00100000:0.0:1789181419.286510:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408413056 00000100:00100000:0.0:1789181419.286522:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408412288 00000100:00100000:0.0:1789181419.286524:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408412288 00000100:00100000:0.0:1789181419.286539:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789181419.286548:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408412672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181419.286779:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408412416 00000100:00100000:3.0:1789181419.286783:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408412416 00000100:00100000:3.0:1789181419.286804:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789181419.286812:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408412416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181419.286854:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408412416:12345-0@lo:400:kworker.0 Request processed in 44us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181419.286861:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789181419.286884:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408412800 00000100:00100000:3.0:1789181419.286887:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408412800 00000100:00100000:3.0:1789181419.286907:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408413312 00000100:00100000:3.0:1789181419.286910:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408413312 00000100:00100000:1.0:1789181419.287142:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408412160:12345-0@lo:400:kworker.0 Request processed in 8898us (9259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181419.287153:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789181419.287194:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408411904 00000100:00100000:1.0:1789181419.287202:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408411904 00000100:00100000:1.0:1789181419.287234:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789181419.287301:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408411904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.287351:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408411904:12345-0@lo:400:kworker.0 Request processed in 111us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181419.287357:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789181419.287388:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408412672:12345-0@lo:400:kworker.0 Request processed in 63us (8634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181419.287401:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789181419.287421:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789181419.287430:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408413184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.287435:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408412160:0@lo:400:kworker.0 00010000:00080000:1.0:1789181419.287454:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3955f80 x1876092408412672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181419.287466:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408412672:0@lo:400:kworker.0 00000100:00100000:0.0:1789181419.287472:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408413184:12345-0@lo:400:kworker.0 Request processed in 43us (9457us total) trans 0 rc 0/0 00010000:00080000:1.0:1789181419.287482:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5de300 x1876092408413184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181419.287482:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789181419.287497:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408413184:0@lo:400:kworker.0 00000100:00100000:0.0:1789181419.287509:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789181419.287519:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408412032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181419.287561:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408412032:12345-0@lo:400:kworker.0 Request processed in 45us (9492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181419.287567:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789181419.287579:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789181419.287586:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408412544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181419.287816:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408412928 00000100:00100000:3.0:1789181419.287821:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408412928 00000100:00100000:3.0:1789181419.287839:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408413440 00000100:00100000:3.0:1789181419.287842:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408413440 00000100:00100000:3.0:1789181419.287859:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789181419.287872:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408412800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181419.287929:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408412544:12345-0@lo:400:kworker.0 Request processed in 344us (9821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181419.287949:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789181419.287962:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789181419.287969:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408413056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.289940:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408412032:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.289964:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408412544:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.293097:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789181419.293118:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408413312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.293251:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408413312:12345-0@lo:400:kworker.0 Request processed in 141us (7658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181419.293259:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789181419.293285:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789181419.293293:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408412928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.293324:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408412928:12345-0@lo:400:kworker.0 Request processed in 33us (7453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181419.293330:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789181419.293356:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789181419.293363:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408413440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.293395:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408413440:12345-0@lo:400:kworker.0 Request processed in 32us (7485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181419.293400:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789181419.295622:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408412800:12345-0@lo:400:kworker.0 Request processed in 7731us (10068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181419.295638:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000004:00080000:3.0:1789181419.295804:0:9990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375283079635ns, next at 376283076975ns, rc = 0 00000100:00100000:3.0:1789181419.295835:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789181419.295848:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408412288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181419.295897:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408412288:12345-0@lo:400:kworker.0 Request processed in 53us (10484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181419.295904:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789181419.295964:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408411904:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.295980:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408413568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181419.295984:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408412416:0@lo:400:kworker.0 00010000:00080000:3.0:1789181419.296004:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc437a300 x1876092408412928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181419.296016:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408412928:0@lo:400:kworker.0 00010000:00080000:3.0:1789181419.296029:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3974380 x1876092408413440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181419.296038:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181419.296044:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408413440:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.296070:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181419.296078:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408413696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181419.296084:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408413568 00000100:00100000:3.0:1789181419.296092:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408413568 00000100:00100000:1.0:1789181419.296101:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181419.296134:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408413696 00000100:00100000:3.0:1789181419.296138:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408413696 00000100:00100000:3.0:1789181419.296153:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789181419.296159:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408413568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181419.296193:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181419.296237:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408413568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181419.296243:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789181419.296255:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789181419.296260:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408413696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181419.296270:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181419.296304:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408413696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181419.296311:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1789181419.296536:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7f64380 x1876092408413696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181419.296565:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408413696:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789181419.296579:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7f65500 x1876092408413568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181419.296596:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408413568:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789181419.296798:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181419.296804:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181419.296808:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181419.296811:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789181419.297844:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408412288:0@lo:400:kworker.0 00010000:00080000:1.0:1789181419.297856:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc387aa00 x1876092408412800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181419.298208:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408412800:0@lo:400:kworker.0 00010000:00080000:1.0:1789181419.298442:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb5dfb80 x1876092408413312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181419.298453:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408413312:0@lo:400:kworker.0 00000100:00100000:0.0:1789181419.299499:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408413056:12345-0@lo:400:kworker.0 Request processed in 11525us (21353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181419.299512:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789181419.308035:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408413056:0@lo:400:kworker.0 00000001:02000400:0.0:1789181419.724279:0:13686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1789181420.045849:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789181420.816068:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1789181420.816113:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1789181420.816132:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789181420.816323:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816334:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816341:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816346:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181420.816352:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816359:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816382:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff9c1dcf5c0b00) 00010000:00010000:3.0:1789181420.816385:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181420.816389:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816395:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835171af lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816417:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816423:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816429:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816433:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181420.816436:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816441:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816448:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c1cc3740100) 00010000:00010000:3.0:1789181420.816450:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181420.816453:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816459:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f200/0x76fb5552835171c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816489:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816496:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816502:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816508:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181420.816511:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816517:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816524:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff9c1dcf5c0b00) 00010000:00010000:3.0:1789181420.816527:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181420.816540:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816546:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351722d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816560:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816567:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816573:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816583:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181420.816587:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816593:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816601:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c1cc3740900) 00010000:00010000:3.0:1789181420.816604:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181420.816607:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.816613:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517249 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181420.816633:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181420.816652:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408413824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789181420.816752:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181420.816823:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408413824 00000100:00100000:3.0:1789181420.816841:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408413824 00000100:00100000:3.0:1789181420.816892:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181420.816901:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408413824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789181420.817403:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1789181420.817440:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa4bde6, atime: 0x6aa4bde6, ctime: 0x6aa4bde6, blocks: 0x0 00010000:00010000:3.0:1789181420.817448:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076c8ffd4/0x76fb555283517257 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.817464:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1789181420.817476:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181420.817484:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076c8ffd4/0x76fb555283517257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.817500:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076c8ffd4/0x76fb555283517257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.817510:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076c8ffd4/0x76fb555283517257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.817517:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076c8ffd4/0x76fb555283517257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.817719:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789181420.818742:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408413824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1821us (1998us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789181420.818753:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1789181420.818810:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1de7f64700/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789181420.818815:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408413824:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789181420.819768:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181420.819780:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076c8ffd4/0x76fb555283517257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.819793:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ec00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181420.819798:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076c8ffd4/0x76fb555283517257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.819807:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076c8ffd4/0x76fb555283517257 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.819829:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076c8ffd4/0x76fb555283517257 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.819835:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076c8ffd4/0x76fb555283517257 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.819869:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181420.819871:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181420.819873:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789181420.829363:0:13735:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcbaebb90 20000000:00000080:0.0:1789181420.829382:0:13735:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c1dff901400 uarg=0000000000000000 20000000:01000000:0.0:1789181420.829425:0:13735:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789181420.829432:0:13735:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789181420.829437:0:13735:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789181420.832392:0:13736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789181420.832566:0:13735:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789181420.855024:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789181420.855064:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789181420.855079:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789181420.855095:0:13735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789181420.855121:0:13735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855152:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0084b000/0x76fb5552835170eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835170e4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855172:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658a400/0x76fb5552835170f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835170f2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855180:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0085e000/0x76fb555283517107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517100 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855187:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0085f400/0x76fb555283517115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351710e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855197:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0085fe00/0x76fb55528351711c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e5e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855203:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc658ac00/0x76fb555283517123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e65 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855211:0:13735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855252:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658ac00/0x76fb555283517123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e65 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855267:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1dc658ac00/0x76fb555283517123 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e65 expref: 12 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.855281:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408413952:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181420.855392:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0085fe00/0x76fb55528351711c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e5e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855407:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0085fe00/0x76fb55528351711c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e5e expref: 12 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.855416:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408414080:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181420.855448:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0085f400/0x76fb555283517115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb55528351710e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855457:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0085f400/0x76fb555283517115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb55528351710e expref: 23 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.855466:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a00a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408414208:0@lo:104: 00000100:00100000:0.0:1789181420.855509:0:13735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181420.855549:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0085e000/0x76fb555283517107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283517100 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855559:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0085e000/0x76fb555283517107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283517100 expref: 23 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.855567:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408414336:0@lo:104: 00010000:00010000:0.0:1789181420.855592:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc658a400/0x76fb5552835170f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb5552835170f2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855600:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1dc658a400/0x76fb5552835170f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb5552835170f2 expref: 23 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.855607:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408414464:0@lo:104: 00010000:00010000:0.0:1789181420.855630:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0084b000/0x76fb5552835170eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb5552835170e4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181420.855644:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0084b000/0x76fb5552835170eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb5552835170e4 expref: 23 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.855653:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a02300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408414592:0@lo:104: 00000100:00100000:0.0:1789181420.855672:0:13735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181420.856071:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789181420.856094:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181420.856117:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181420.856131:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181420.856139:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408414208 00000100:00100000:2.0:1789181420.856147:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408414208 00000100:00100000:2.0:1789181420.856196:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408414336 00000100:00100000:2.0:1789181420.856199:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408414336 00000100:00100000:2.0:1789181420.856219:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408414464 00000100:00100000:2.0:1789181420.856221:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408414464 00000100:00100000:2.0:1789181420.856229:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408414592 00000100:00100000:2.0:1789181420.856231:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408414592 00000100:00100000:2.0:1789181420.856242:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789181420.856251:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff946c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+6:13735:x1876092408414208:12345-0@lo:104: 00010000:00010000:2.0:1789181420.856265:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856323:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789181420.856329:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff946c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+6:13735:x1876092408414208:12345-0@lo:104: Request processed in 80us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181420.856336:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789181420.856370:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789181420.856377:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+5:13735:x1876092408414336:12345-0@lo:104: 00010000:00010000:2.0:1789181420.856384:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856417:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789181420.856421:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+5:13735:x1876092408414336:12345-0@lo:104: Request processed in 46us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181420.856426:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789181420.856438:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789181420.856444:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:13735:x1876092408414464:12345-0@lo:104: 00010000:00010000:2.0:1789181420.856451:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856481:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789181420.856491:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+4:13735:x1876092408414464:12345-0@lo:104: Request processed in 48us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181420.856497:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789181420.856509:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789181420.856516:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:13735:x1876092408414592:12345-0@lo:104: 00010000:00010000:2.0:1789181420.856523:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856562:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789181420.856567:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da575344-f445-48a7-8532-0e6efd2ea878+3:13735:x1876092408414592:12345-0@lo:104: Request processed in 52us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181420.856573:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789181420.856591:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789181420.856597:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856604:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181420.856609:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856617:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181420.856625:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181420.856630:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181420.856663:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856680:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181420.856704:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856711:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a200/0x76fb55528351710e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517115 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856759:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789181420.856763:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856769:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084aa00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181420.856771:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856777:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181420.856783:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181420.856788:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181420.856801:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856807:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181420.856827:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856834:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0084aa00/0x76fb555283517100 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283517107 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856848:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181420.856851:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856858:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181420.856861:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856867:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181420.856873:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181420.856879:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181420.856891:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856897:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181420.856903:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856909:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b200/0x76fb5552835170f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835170f9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856918:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181420.856921:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856935:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658ba00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181420.856938:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856945:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181420.856951:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181420.856956:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181420.856968:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856974:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181420.856980:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.856985:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ba00/0x76fb5552835170e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835170eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181420.857515:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408414720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181420.857579:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181420.857625:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181420.857631:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408415104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181420.857652:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181420.857678:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408414976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181420.857711:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181420.857880:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181420.857882:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181420.857884:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181420.857891:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181420.857910:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181420.858095:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181420.858103:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408414848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181420.858127:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181420.858196:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408414720 00000100:00100000:3.0:1789181420.858205:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408414720 00010000:00010000:3.0:1789181420.858242:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0085f400/0x76fb555283517115 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb55528351710e expref: 24 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181420.858262:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408415104 00000100:00100000:3.0:1789181420.858265:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408415104 00010000:00010000:3.0:1789181420.858278:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0084b000/0x76fb5552835170eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835170e4 expref: 25 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181420.858289:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408414976 00000100:00100000:3.0:1789181420.858292:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408414976 00010000:00010000:3.0:1789181420.858301:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658a400/0x76fb5552835170f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835170f2 expref: 26 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181420.858310:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408414848 00000100:00100000:3.0:1789181420.858312:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408414848 00010000:00010000:3.0:1789181420.858321:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0085e000/0x76fb555283517107 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283517100 expref: 27 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181420.858335:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789181420.858343:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+27:3644:x1876092408414720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181420.858355:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181420.858360:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0085f400/0x76fb555283517115 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb55528351710e expref: 27 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.858382:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0085f400/0x76fb555283517115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb55528351710e expref: 27 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.858399:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181420.858433:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+27:3644:x1876092408414720:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181420.858440:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789181420.858457:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789181420.858463:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+26:3644:x1876092408415104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181420.858470:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181420.858474:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0084b000/0x76fb5552835170eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835170e4 expref: 26 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.858482:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0084b000/0x76fb5552835170eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb5552835170e4 expref: 26 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181420.858490:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181420.858512:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da575344-f445-48a7-8532-0e6efd2ea878+26:3644:x1876092408415104:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181420.858517:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789181420.858627:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181420.858636:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+25:3646:x1876092408414976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181420.858644:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181420.858654:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc658a400/0x76fb5552835170f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835170f2 expref: 25 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.858663:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658a400/0x76fb5552835170f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb5552835170f2 expref: 25 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.858672:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181420.858705:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+25:3646:x1876092408414976:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181420.858711:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181420.858748:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181420.858755:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408414848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181420.858762:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181420.858766:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0085e000/0x76fb555283517107 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283517100 expref: 24 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.858772:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0085e000/0x76fb555283517107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283517100 expref: 24 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.858781:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181420.858801:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408414848:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181420.858807:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181420.858858:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408415104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181420.858867:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408414720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181420.858905:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408414848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181420.858912:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408414976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181420.859049:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085f400/0x76fb555283517115 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb55528351710e expref: 23 pid: 6516 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.859061:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a00a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408414208:0@lo:104: 00010000:00010000:0.0:1789181420.859072:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085e000/0x76fb555283517107 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283517100 expref: 22 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.859080:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408414336:0@lo:104: 00010000:00010000:0.0:1789181420.859091:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658a400/0x76fb5552835170f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb5552835170f2 expref: 21 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.859099:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408414464:0@lo:104: 00010000:00010000:0.0:1789181420.859107:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0084b000/0x76fb5552835170eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb5552835170e4 expref: 20 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.859114:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a02300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408414592:0@lo:104: 00000100:00100000:1.0:1789181420.861302:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181420.861681:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385257856 00000100:00100000:2.0:1789181420.861692:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385257856 00010000:00010000:2.0:1789181420.861747:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc658ac00/0x76fb555283517123 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e65 expref: 13 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181420.861786:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:2.0:1789181420.861809:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3971f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385257856:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181420.861827:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181420.861832:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc658ac00/0x76fb555283517123 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e65 expref: 13 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.861854:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc658ac00/0x76fb555283517123 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e65 expref: 13 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181420.861875:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181420.861939:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3971f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385257856:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 143us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181420.861946:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:1.0:1789181420.862816:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181420.863026:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385257984 00000100:00100000:1.0:1789181420.863035:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385257984 00010000:00010000:1.0:1789181420.863064:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0085fe00/0x76fb55528351711c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e5e expref: 13 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181420.863093:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1789181420.863101:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385257984:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181420.863111:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181420.863115:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0085fe00/0x76fb55528351711c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e5e expref: 13 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863124:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0085fe00/0x76fb55528351711c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e5e expref: 13 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863141:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863151:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863180:0:7462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863188:0:7462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863214:0:7462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863221:0:7462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863228:0:7462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658b600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181420.863232:0:7462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863241:0:7462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863250:0:7462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863261:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181420.863364:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385257984:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 263us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181420.863372:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00010000:00010000:0.0:1789181420.863708:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658ac00/0x76fb555283517123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e65 expref: 12 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181420.863736:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408413952:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181420.863827:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085fe00/0x76fb55528351711c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e5e expref: 11 pid: 6515 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181420.863837:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876092408414080:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181420.863888:0:13735:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863898:0:13735:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863925:0:13735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181420.863933:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658b600/0x76fb55528351725e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181421.068641:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181421.324326:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408415232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789181421.324400:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181421.324699:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408415232 00000100:00100000:3.0:1789181421.324710:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408415232 00000100:00100000:3.0:1789181421.324776:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789181421.324785:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408415232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181421.324823:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789181421.324881:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408415232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181421.324897:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789181421.325422:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408415232:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1789181421.768654:0:13784:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8f1ab030 20000000:00000080:2.0:1789181421.768679:0:13784:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c1dff8fa400 uarg=0000000000000000 20000000:01000000:2.0:1789181421.769049:0:13784:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1789181421.769058:0:13784:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1789181421.769064:0:13784:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789181421.769709:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1789181421.770234:0:13784:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1789181421.770360:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1789181421.770403:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1789181421.770422:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1789181421.770437:0:13784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789181421.770470:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181421.770494:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181421.770509:0:13784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181421.770516:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181421.770525:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181421.770533:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181421.770540:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084ba00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181421.770546:0:13784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181421.770556:0:13784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181421.770573:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181421.770583:0:13784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181421.770597:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0084ba00/0x76fb555283517265 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181422.092005:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181422.092018:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1cc2475000 from 7 10000000:01000000:2.0:1789181422.092026:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181422.092098:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181422.092114:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181422.092142:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181422.092192:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408415360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181422.092431:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181422.092539:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181422.092653:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181422.092680:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408415360 00000100:00100000:1.0:1789181422.092691:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408415360 00000100:00100000:1.0:1789181422.092810:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789181422.092822:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+20:6518:x1876092408415360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181422.092841:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181422.092858:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1de0b12000/0x76fb555283517273 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351726c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.092885:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1de0b12000/0x76fb555283517273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351726c expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.092893:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1de0b12000/0x76fb555283517273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351726c expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.092901:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12000, rc 0) 00000100:00100000:1.0:1789181422.093792:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408415360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 966us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.093801:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789181422.094374:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408415360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181422.094406:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181422.094421:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181422.094535:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408415488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181422.094586:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181422.094659:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181422.094805:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408415488 00000100:00100000:1.0:1789181422.094812:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408415488 00000100:00100000:1.0:1789181422.094872:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789181422.094882:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408415488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.095069:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408415488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.095078:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789181422.095171:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408415488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181422.095219:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408415616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181422.096404:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181422.096546:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408415616 00000100:00100000:1.0:1789181422.096556:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408415616 00000100:00100000:3.0:1789181422.096687:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc26d5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181422.096775:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789181422.096784:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408415616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.096963:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408415616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.096969:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789181422.097036:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408415616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181422.098757:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13797:1876092408415744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181422.098833:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181422.098881:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181422.098901:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408415744 00000100:00100000:1.0:1789181422.098915:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408415744 00000100:00100000:1.0:1789181422.098976:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789181422.098984:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:13797:x1876092408415744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181422.099166:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:13797:x1876092408415744:12345-0@lo:502:llog_process_th.0 Request processed in 181us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.099175:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789181422.099226:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13797:1876092408415744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181422.099260:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181422.099277:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181422.099279:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789181422.099288:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1cc2475000 00000020:00000080:2.0:1789181422.099290:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789181422.099385:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181422.099388:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181422.099389:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789181422.099391:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181422.099393:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181422.099394:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789181422.099396:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1cc2475000 00000020:00000080:2.0:1789181422.099397:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789181422.100995:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3880380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13797:1876092408415872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181422.101073:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181422.101205:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181422.102661:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408415872 00000100:00100000:1.0:1789181422.102683:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408415872 00000100:00100000:1.0:1789181422.102796:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789181422.102810:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:13797:x1876092408415872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181422.103028:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+21:13797:x1876092408415872:12345-0@lo:502:llog_process_th.0 Request processed in 221us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.103036:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789181422.103058:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3880380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13797:1876092408415872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181422.103110:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181422.103120:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181422.103123:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789181422.103129:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789181422.103678:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789181422.103757:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181422.103770:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181422.103782:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181422.103793:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789181422.103795:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dfb02c800 from 7 10000000:01000000:3.0:1789181422.103797:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181422.103838:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181422.103844:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181422.103852:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181422.103878:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789181422.103936:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181422.103977:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc26d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181422.104325:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408416000 00000100:00100000:1.0:1789181422.104341:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408416000 00000100:00100000:1.0:1789181422.104421:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789181422.104434:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+21:6518:x1876092408416000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181422.104456:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181422.104476:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1de0b13e00/0x76fb555283517281 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351727a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.104507:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1de0b13e00/0x76fb555283517281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351727a expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.104521:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1de0b13e00/0x76fb555283517281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351727a expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.104532:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13e00, rc 0) 00000100:00100000:1.0:1789181422.104628:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408416000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.104635:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789181422.104768:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181422.104790:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.104799:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181422.104880:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181422.104915:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181422.104996:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181422.105032:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408416128 00000100:00100000:1.0:1789181422.105037:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408416128 00000100:00100000:1.0:1789181422.105094:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789181422.105101:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408416128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.105328:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408416128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.105336:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789181422.105392:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181422.105422:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181422.105465:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181422.105478:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181422.105490:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408416256 00000100:00100000:0.0:1789181422.105495:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408416256 00000100:00100000:0.0:1789181422.105532:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789181422.105538:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408416256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181422.105617:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408416256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.105631:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789181422.105670:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181422.105838:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13800:1876092408416384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181422.105870:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181422.105888:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408416384 00000100:00100000:0.0:1789181422.105892:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408416384 00000100:00100000:0.0:1789181422.105908:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789181422.105913:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:13800:x1876092408416384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181422.105976:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:13800:x1876092408416384:12345-0@lo:502:llog_process_th.0 Request processed in 61us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.105982:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789181422.106007:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae780 going to sleep for 11 seconds 00000100:00100000:0.0:1789181422.106017:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13800:1876092408416384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181422.106036:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181422.106045:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181422.106047:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789181422.106053:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1dfb02c800 00000020:00000080:0.0:1789181422.106055:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789181422.106107:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181422.106111:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181422.106112:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789181422.106114:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181422.106117:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181422.106118:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789181422.106205:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1dfb02c800 00000020:00000080:0.0:1789181422.106208:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789181422.106254:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13800:1876092408416512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181422.106292:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181422.106317:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408416512 00000100:00100000:0.0:1789181422.106320:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408416512 00000100:00100000:0.0:1789181422.106346:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789181422.106353:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:13800:x1876092408416512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181422.106410:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:13800:x1876092408416512:12345-0@lo:502:llog_process_th.0 Request processed in 57us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.106416:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789181422.106450:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae780 going to sleep for 11 seconds 00000100:00100000:0.0:1789181422.106463:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13800:1876092408416512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181422.106480:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181422.106484:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181422.106485:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789181422.106490:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789181422.106552:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789181422.106571:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181422.106579:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.106590:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181422.106601:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789181422.106604:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1df1a64800 from 7 10000000:01000000:0.0:1789181422.106606:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789181422.106633:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.106653:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.106664:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181422.106677:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181422.106705:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181422.106719:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae780 going to sleep for 11 seconds 00000100:00100000:0.0:1789181422.106775:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408416640 00000100:00100000:0.0:1789181422.106779:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408416640 00000100:00100000:0.0:1789181422.106798:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789181422.106804:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+22:6518:x1876092408416640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181422.106812:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181422.106824:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658a400/0x76fb55528351728f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283517288 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.106843:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658a400/0x76fb55528351728f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283517288 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.106852:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658a400/0x76fb55528351728f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517288 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.106860:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658a400, rc 0) 00000100:00100000:0.0:1789181422.106898:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408416640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.106904:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789181422.106945:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181422.106956:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.106965:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181422.107005:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181422.107030:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181422.107057:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae780 going to sleep for 11 seconds 00000100:00100000:3.0:1789181422.107096:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408416768 00000100:00100000:3.0:1789181422.107110:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408416768 00000100:00100000:3.0:1789181422.107439:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789181422.107453:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408416768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181422.107672:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408416768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181422.107682:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789181422.107815:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.107874:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.107947:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181422.107982:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7fe3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181422.108007:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408416896 00000100:00100000:1.0:1789181422.108018:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408416896 00000100:00100000:1.0:1789181422.108060:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789181422.108068:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408416896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.108945:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408416896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 870us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.108955:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789181422.109021:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408416896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.109484:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13801:1876092408417024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181422.109544:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181422.109586:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7fe3780 going to sleep for 11 seconds 00000100:00100000:1.0:1789181422.110014:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408417024 00000100:00100000:1.0:1789181422.110023:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408417024 00000100:00100000:1.0:1789181422.110083:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789181422.110097:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+23:13801:x1876092408417024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181422.111532:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+23:13801:x1876092408417024:12345-0@lo:502:llog_process_th.0 Request processed in 1429us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.111569:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13801:1876092408417024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181422.111625:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181422.111639:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181422.111642:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789181422.111650:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1df1a64800 00000020:00000080:0.0:1789181422.111655:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789181422.111774:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181422.111779:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181422.111782:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789181422.111785:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181422.111789:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181422.111790:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789181422.111795:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1df1a64800 00000020:00000080:0.0:1789181422.111798:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789181422.111862:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13801:1876092408417152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181422.111883:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789181422.111931:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181422.111955:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408417152 00000100:00100000:1.0:1789181422.111964:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408417152 00000100:00100000:0.0:1789181422.111992:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181422.112013:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789181422.112024:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+23:13801:x1876092408417152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181422.112119:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+23:13801:x1876092408417152:12345-0@lo:502:llog_process_th.0 Request processed in 97us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.112134:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789181422.112163:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13801:1876092408417152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181422.112200:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181422.112205:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181422.112207:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789181422.112211:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789181422.112334:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789181422.112366:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789181422.112380:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.112393:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181422.112485:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789181422.112489:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dc32aa000 from 7 10000000:01000000:1.0:1789181422.112493:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789181422.112529:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.112538:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.112910:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181422.112931:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408417280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.112976:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181422.113020:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408417280 00000100:00100000:1.0:1789181422.113021:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181422.113028:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408417280 00000100:00100000:0.0:1789181422.113075:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789181422.113087:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+23:6518:x1876092408417280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181422.113101:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181422.113118:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658aa00/0x76fb55528351729d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283517296 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.113162:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658aa00/0x76fb55528351729d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283517296 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.113177:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658aa00/0x76fb55528351729d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283517296 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.113186:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658aa00, rc 0) 00000100:00100000:0.0:1789181422.113239:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408417280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.113247:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000040:00080000:2.0:1789181422.113872:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789181422.115205:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408417280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181422.115246:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.115264:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181422.115415:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408417408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.115508:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181422.115591:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181422.116814:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408417408 00000100:00100000:0.0:1789181422.116832:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408417408 00000100:00100000:0.0:1789181422.116907:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789181422.116920:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408417408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181422.117182:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408417408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.117213:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789181422.117267:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408417408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181422.117403:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408417536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181422.117465:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181422.117520:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc26d5240 going to sleep for 11 seconds 00000100:00100000:0.0:1789181422.117538:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408417536 00000100:00100000:0.0:1789181422.117544:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408417536 00000100:00100000:0.0:1789181422.117583:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789181422.117591:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408417536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181422.117675:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:6518:x1876092408417536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.117682:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789181422.117830:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da575344-f445-48a7-8532-0e6efd2ea878:6518:1876092408417536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181422.118221:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13803:1876092408417664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181422.118282:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181422.118315:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc26d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181422.118357:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408417664 00000100:00100000:0.0:1789181422.118363:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408417664 00000100:00100000:0.0:1789181422.118401:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789181422.118410:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:13803:x1876092408417664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181422.118495:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:13803:x1876092408417664:12345-0@lo:502:llog_process_th.0 Request processed in 87us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.118503:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789181422.118636:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13803:1876092408417664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181422.118659:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181422.118670:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181422.118673:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789181422.118683:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1dc32aa000 00000020:00000080:3.0:1789181422.118685:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789181422.118791:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181422.118795:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181422.118796:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789181422.118799:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181422.118809:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181422.118810:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789181422.118814:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1dc32aa000 00000020:00000080:3.0:1789181422.118816:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789181422.118853:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13803:1876092408417792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181422.118887:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181422.118906:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc26d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181422.119310:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408417792 00000100:00100000:0.0:1789181422.119316:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408417792 00000100:00100000:0.0:1789181422.119356:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789181422.119365:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:13803:x1876092408417792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181422.119468:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:13803:x1876092408417792:12345-0@lo:502:llog_process_th.0 Request processed in 103us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.119476:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789181422.119628:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da575344-f445-48a7-8532-0e6efd2ea878:13803:1876092408417792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181422.119651:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181422.119657:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181422.119659:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789181422.119665:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789181422.119924:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789181422.119954:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181422.119966:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.119992:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181422.127643:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789181422.772587:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181422.777958:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385258112 00000100:00100000:0.0:1789181422.777981:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385258112 00000100:00100000:0.0:1789181422.778088:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 361 00000100:00100000:0.0:1789181422.778102:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+11:6170:x1876092385258112:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181422.778126:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181422.778163:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658be00/0x76fb5552835172a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7eb2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.778206:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658be00/0x76fb5552835172a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eb2 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.778219:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658be00/0x76fb5552835172a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eb2 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.778230:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658be00, rc 0) 00000100:00100000:0.0:1789181422.778333:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385258112:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 233us (5758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.778341:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 361 00000100:00100000:2.0:1789181422.789551:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181422.789638:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385258240 00000100:00100000:1.0:1789181422.789653:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385258240 00000100:00100000:1.0:1789181422.789785:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 362 00000100:00100000:1.0:1789181422.789799:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385258240:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.790008:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385258240:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 211us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.790017:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 362 00000100:00100000:1.0:1789181422.821616:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181422.822011:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385258368 00000100:00100000:3.0:1789181422.822025:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385258368 00000100:00100000:3.0:1789181422.822099:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 363 00000100:00100000:3.0:1789181422.822113:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385258368:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181422.822359:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385258368:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 248us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181422.822368:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 363 00000100:00100000:2.0:1789181422.826239:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181422.826639:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385258496 00000100:00100000:0.0:1789181422.826654:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385258496 00000100:00100000:0.0:1789181422.826784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 364 00000100:00100000:0.0:1789181422.826799:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+12:10788:x1876092385258496:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181422.827253:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+12:10788:x1876092385258496:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 457us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.827273:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 364 00000100:00100000:2.0:1789181422.837113:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181422.837851:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385258624 00000100:00100000:1.0:1789181422.837867:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385258624 00000100:00100000:1.0:1789181422.837959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 365 00000100:00100000:1.0:1789181422.837974:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+12:10788:x1876092385258624:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181422.838228:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+12:10788:x1876092385258624:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 257us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.838238:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 365 00000100:00100000:1.0:1789181422.850089:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181422.850757:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385258752 00000100:00100000:0.0:1789181422.850772:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385258752 00000100:00100000:0.0:1789181422.850848:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 366 00000100:00100000:0.0:1789181422.850861:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+12:6170:x1876092385258752:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181422.850883:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181422.850919:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658b600/0x76fb5552835172ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7eb9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.850955:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658b600/0x76fb5552835172ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eb9 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.850968:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658b600/0x76fb5552835172ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eb9 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181422.850980:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b600, rc 0) 00000100:00100000:0.0:1789181422.851065:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:6170:x1876092385258752:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 206us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.851074:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 366 00000100:00100000:2.0:1789181422.855924:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181422.856154:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385258880 00000100:00100000:3.0:1789181422.856170:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385258880 00000100:00100000:3.0:1789181422.856319:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 367 00000100:00100000:3.0:1789181422.856335:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:6170:x1876092385258880:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181422.857235:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:6170:x1876092385258880:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 900us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181422.857246:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 367 00000100:00100000:3.0:1789181422.860314:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181422.860436:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408417920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181422.860527:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181422.864127:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181422.864175:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408418048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181422.864433:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181422.868619:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181422.868664:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385259008 00000100:00100000:1.0:1789181422.868678:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385259008 00000100:00100000:1.0:1789181422.870390:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 368 00000100:00100000:1.0:1789181422.870425:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:6170:x1876092385259008:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181422.870674:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:6170:x1876092385259008:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 267us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.870686:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 368 00000100:00100000:2.0:1789181422.889204:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181422.889427:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385259136 00000100:00100000:1.0:1789181422.889441:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385259136 00000100:00100000:1.0:1789181422.889518:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 369 00000100:00100000:1.0:1789181422.889530:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:10791:x1876092385259136:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181422.889714:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:10791:x1876092385259136:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 185us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.889753:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 369 00000100:00100000:0.0:1789181422.900928:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408417920 00000100:00100000:0.0:1789181422.900953:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408417920 00000100:00100000:0.0:1789181422.901079:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408418048 00000100:00100000:0.0:1789181422.901084:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408418048 00000100:00100000:0.0:1789181422.901109:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789181422.901120:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408417920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181422.901179:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181422.901322:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408417920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 203us (40795us total) trans 0 rc 0/0 00000100:00080000:2.0:1789181422.901629:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789181422.901702:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3a01180 x1876092408417920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181422.901753:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408417920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181422.902391:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789181422.902424:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789181422.902436:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408418048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181422.902459:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181422.902537:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408418048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (38105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181422.902544:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:2.0:1789181422.902792:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc387aa00 x1876092408418048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181422.902813:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408418048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181422.904635:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181422.904800:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385259264 00000100:00100000:2.0:1789181422.904813:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385259264 00000100:00100000:2.0:1789181422.904878:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 370 00000100:00100000:2.0:1789181422.904892:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:10791:x1876092385259264:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181422.905102:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:10791:x1876092385259264:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 212us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181422.905111:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 370 00000100:00100000:1.0:1789181422.958130:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181422.958211:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181422.958266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181422.958287:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181422.958328:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181422.958385:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385259392 00000100:00100000:1.0:1789181422.958398:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385259392 00000100:00100000:1.0:1789181422.958472:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385259904 00000100:00100000:1.0:1789181422.958475:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385259904 00000100:00100000:1.0:1789181422.958490:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385259520 00000100:00100000:1.0:1789181422.958492:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385259520 00000100:00100000:1.0:1789181422.958505:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385259776 00000100:00100000:1.0:1789181422.958507:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385259776 00000100:00100000:1.0:1789181422.958524:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:1.0:1789181422.958536:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385259392:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181422.958664:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385259392:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 114us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.958692:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:1.0:1789181422.958712:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:1.0:1789181422.958718:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385259904:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181422.958776:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385259904:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 58us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.958782:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:1.0:1789181422.958793:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:1.0:1789181422.958800:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385259520:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181422.958822:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385259520:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.958828:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:1.0:1789181422.958839:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:1.0:1789181422.958845:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385259776:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181422.958866:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385259776:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.958872:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00080000:1.0:1789181422.958896:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181422.958902:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181422.959771:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385259648 00000100:00100000:2.0:1789181422.959785:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385259648 00000100:00100000:2.0:1789181422.959854:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:2.0:1789181422.959865:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385259648:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181422.959926:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385259648:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 62us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181422.959934:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00080000:1.0:1789181422.960764:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789181423.116877:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789181423.117753:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181423.180869:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789181423.884777:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408418176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181423.884879:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181423.889914:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408418176 00000100:00100000:1.0:1789181423.889938:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408418176 00000100:00100000:1.0:1789181423.890043:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789181423.890056:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408418176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181423.890111:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789181423.890289:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408418176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 235us (5409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181423.890297:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789181423.890501:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408418176:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789181424.140487:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181424.396102:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181424.396277:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181424.396306:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408418432:0@lo:400:kworker.0 00000100:00100000:2.0:1789181424.396413:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181424.396498:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408418432 00000100:00100000:2.0:1789181424.396508:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408418432 00000100:00100000:2.0:1789181424.396567:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789181424.396578:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408418432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181424.396639:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408418432:12345-0@lo:400:kworker.0 Request processed in 62us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181424.396647:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789181424.396700:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408418432:0@lo:400:kworker.0 00000100:00100000:2.0:1789181424.397110:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408418816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181424.398172:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181424.398240:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181424.398250:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408418688:0@lo:400:kworker.0 00000100:00100000:2.0:1789181424.398290:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181424.398332:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408418560:0@lo:400:kworker.0 00000100:00100000:2.0:1789181424.398362:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181424.398429:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408418688 00000100:00100000:2.0:1789181424.398437:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408418688 00000100:00100000:2.0:1789181424.398487:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789181424.398496:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408418688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181424.398575:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408418688:12345-0@lo:400:kworker.0 Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181424.398582:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789181424.398624:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408418688:0@lo:400:kworker.0 00000100:00100000:2.0:1789181424.398660:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408418560 00000100:00100000:2.0:1789181424.398664:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408418560 00000100:00100000:2.0:1789181424.398692:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789181424.398698:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc360e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408418560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181424.398752:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc360e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408418560:12345-0@lo:400:kworker.0 Request processed in 54us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181424.398758:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789181424.398783:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408418560:0@lo:400:kworker.0 00000100:00100000:2.0:1789181424.398809:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408418816 00000100:00100000:2.0:1789181424.398813:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408418816 00000100:00100000:2.0:1789181424.398848:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789181424.398854:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408418816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789181424.398880:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181424.398914:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408418816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181424.398920:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789181424.398947:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408418816:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789181424.398986:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181424.399811:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408418304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181424.399873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181424.403254:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408418304 00000100:00100000:2.0:1789181424.403282:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408418304 00000100:00100000:2.0:1789181424.403406:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789181424.403419:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408418304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181424.403479:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181424.403593:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408418304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (3718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181424.403600:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1789181424.403715:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181424.403814:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408418304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181424.406304:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408419200:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.406401:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181424.406454:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408419712:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.406479:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181424.406512:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408419200 00000100:00100000:0.0:1789181424.406522:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408419200 00000100:00100000:0.0:1789181424.406591:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408419712 00000100:00100000:0.0:1789181424.406594:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408419712 00000100:00100000:0.0:1789181424.406622:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789181424.406631:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408419200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.406687:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408419200:12345-0@lo:400:kworker.0 Request processed in 57us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181424.406717:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789181424.406760:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789181424.406766:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408419712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.406797:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408419712:12345-0@lo:400:kworker.0 Request processed in 31us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181424.406803:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:0.0:1789181424.406824:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181424.406864:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408419712:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.406893:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408419200:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.406902:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789181424.406908:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408419328:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.406932:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181424.406952:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408419328 00000100:00100000:0.0:1789181424.406955:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408419328 00000100:00100000:0.0:1789181424.406980:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789181424.406986:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408419328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.407016:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408419328:12345-0@lo:400:kworker.0 Request processed in 31us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181424.407022:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:0.0:1789181424.407037:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789181424.407054:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3957800 x1876092408419328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181424.407066:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408419328:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.407073:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408419840:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.407107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181424.407139:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408419840 00000100:00100000:0.0:1789181424.407143:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408419840 00000100:00100000:0.0:1789181424.407169:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789181424.407174:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408419840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.407360:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408419840:12345-0@lo:400:kworker.0 Request processed in 185us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181424.407366:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:0.0:1789181424.407381:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789181424.407398:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc255aa00 x1876092408419840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181424.407408:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408419840:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.407453:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408418944:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.407480:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181424.407500:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408418944 00000100:00100000:0.0:1789181424.407504:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408418944 00000100:00100000:0.0:1789181424.407531:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789181424.407537:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408418944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.407568:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408418944:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181424.407573:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789181424.407597:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408418944:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.407604:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408419456:0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.407630:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181424.407658:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408419456 00000100:00100000:0.0:1789181424.407669:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408419456 00000100:00100000:0.0:1789181424.407704:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789181424.407711:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408419456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.407772:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408419456:12345-0@lo:400:kworker.0 Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181424.407779:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1789181424.407797:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181424.407813:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3955180 x1876092408419456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181424.407823:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408419456:0@lo:400:kworker.0 00000100:00100000:1.0:1789181424.407916:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408419072:0@lo:400:kworker.0 00000100:00100000:1.0:1789181424.407956:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181424.407980:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408419584:0@lo:400:kworker.0 00000100:00100000:1.0:1789181424.408002:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181424.408037:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408419584 00000100:00100000:1.0:1789181424.408041:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408419584 00000100:00100000:1.0:1789181424.408076:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789181424.408082:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408419584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181424.408118:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408419584:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181424.408135:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1789181424.408164:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3955c00 x1876092408419584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181424.409644:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408419584:0@lo:400:kworker.0 00000100:00080000:1.0:1789181424.409713:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181424.410003:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408419072 00000100:00100000:0.0:1789181424.410157:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408419072 00000100:00100000:0.0:1789181424.410396:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789181424.410410:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc2559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408419072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181424.410544:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc2559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408419072:12345-0@lo:400:kworker.0 Request processed in 138us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181424.410553:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789181424.410642:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408419072:0@lo:400:kworker.0 00010000:00010000:2.0:1789181425.164214:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181426.189047:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181426.444039:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408419968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181426.444151:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181426.444767:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408419968 00000100:00100000:1.0:1789181426.444783:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408419968 00000100:00100000:1.0:1789181426.444858:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789181426.444870:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408419968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181426.444925:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181426.450767:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408419968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5879us (6596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181426.450814:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789181426.452636:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408419968:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1789181426.961834:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:1.0:1789181427.212333:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181427.980404:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181427.980429:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408420096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181427.980504:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181427.981146:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408420096 00000100:00100000:1.0:1789181427.981156:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408420096 00000100:00100000:1.0:1789181427.981223:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789181427.981234:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408420096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181427.981275:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181427.981328:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408420096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181427.981335:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1789181427.982165:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789181427.982209:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc35f8e00 x1876092408420096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181427.982229:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408420096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181427.983464:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408420224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181427.983522:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181427.988806:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408420224 00000100:00100000:2.0:1789181427.988822:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408420224 00000100:00100000:2.0:1789181427.988977:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789181427.988988:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408420224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789181427.989013:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181427.989126:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408420224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (5603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181427.989133:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1789181427.990131:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3955c00 x1876092408420224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181427.990167:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408420224:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789181427.992320:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181428.072385:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181428.072428:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181428.072461:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181428.072498:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181428.072520:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181428.072586:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181428.072616:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385260032 00000100:00100000:1.0:1789181428.072625:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385260032 00000100:00100000:1.0:1789181428.072677:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 372 00000100:00100000:1.0:1789181428.072687:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd22d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385260032:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181428.072784:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd22d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385260032:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 98us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181428.072807:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 372 00000100:00100000:1.0:1789181428.072839:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385260160 00000100:00100000:1.0:1789181428.072842:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385260160 00000100:00100000:1.0:1789181428.072870:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385260672 00000100:00100000:1.0:1789181428.072873:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385260672 00000100:00100000:1.0:1789181428.072885:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385260288 00000100:00100000:1.0:1789181428.072887:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385260288 00000100:00100000:1.0:1789181428.072899:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385260544 00000100:00100000:1.0:1789181428.072900:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385260544 00000100:00100000:1.0:1789181428.072913:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 243 00000100:00100000:1.0:1789181428.072920:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385260160:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181428.072952:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385260160:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181428.072957:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 243 00000100:00100000:1.0:1789181428.072968:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 244 00000100:00100000:1.0:1789181428.072974:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385260672:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181428.072996:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385260672:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181428.073001:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 244 00000100:00100000:1.0:1789181428.073011:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 245 00000100:00100000:1.0:1789181428.073017:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385260288:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181428.073038:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385260288:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181428.073043:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 245 00000100:00100000:1.0:1789181428.073054:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 246 00000100:00100000:1.0:1789181428.073067:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385260544:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181428.073103:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385260544:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181428.073109:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 246 00000100:00080000:1.0:1789181428.073495:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181428.073500:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181428.076665:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385260416 00000100:00100000:3.0:1789181428.076680:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385260416 00000100:00100000:3.0:1789181428.076840:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:3.0:1789181428.078306:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385260416:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181428.078410:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385260416:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 1559us (5979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181428.078420:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00080000:1.0:1789181428.085312:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789181428.236390:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181429.004077:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408420352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181429.004157:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181429.004372:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408420352 00000100:00100000:1.0:1789181429.004381:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408420352 00000100:00100000:1.0:1789181429.004445:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789181429.004454:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408420352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181429.004496:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789181429.013028:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408420352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8565us (8860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181429.013043:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789181429.013324:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408420352:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789181429.260058:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181429.516073:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408420608:0@lo:400:kworker.0 00000100:00100000:2.0:1789181429.516177:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408420736:0@lo:400:kworker.0 00000100:00100000:0.0:1789181429.516187:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181429.516212:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181429.516269:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408421120:0@lo:400:kworker.0 00000100:00100000:3.0:1789181429.516296:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408420864:0@lo:400:kworker.0 00000100:00100000:0.0:1789181429.516296:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181429.516312:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408421632:0@lo:400:kworker.0 00000100:00100000:3.0:1789181429.516323:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181429.516331:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181429.516343:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408421376:0@lo:400:kworker.0 00000100:00100000:0.0:1789181429.516344:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408422144:0@lo:400:kworker.0 00000100:00100000:3.0:1789181429.516361:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181429.516361:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181429.516374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408421888:0@lo:400:kworker.0 00000100:00100000:0.0:1789181429.516376:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789181429.516381:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408420480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181429.516392:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181429.516398:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181429.516408:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181429.516413:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408422272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181429.516413:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408420992:0@lo:400:kworker.0 00000100:00100000:0.0:1789181429.516431:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181429.516432:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181429.516446:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408421504:0@lo:400:kworker.0 00000100:00100000:3.0:1789181429.516459:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408420480 00000100:00100000:0.0:1789181429.516465:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181429.516472:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408420480 00000100:00100000:0.0:1789181429.516479:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408422016:0@lo:400:kworker.0 00000100:00100000:0.0:1789181429.516495:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181429.516516:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408422272 00000100:00100000:0.0:1789181429.516518:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408421120 00000100:00100000:3.0:1789181429.516519:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408422272 00000100:00100000:0.0:1789181429.516521:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408421120 00000100:00100000:3.0:1789181429.516536:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789181429.516540:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408420864 00000100:00100000:0.0:1789181429.516542:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408420864 00000100:00100000:3.0:1789181429.516543:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408420480:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181429.516552:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789181429.516557:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408421120:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789181429.516572:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181429.516612:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408421120:12345-0@lo:400:kworker.0 Request processed in 53us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181429.516614:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408420480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181429.516619:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789181429.516620:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789181429.516635:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789181429.516637:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789181429.516640:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408422272:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181429.516642:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408420864:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789181429.516649:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181429.516887:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408420608 00000100:00100000:1.0:1789181429.516893:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408420608 00000100:00100000:1.0:1789181429.516922:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789181429.516930:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408420608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181429.516992:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408420864:12345-0@lo:400:kworker.0 Request processed in 348us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181429.516998:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789181429.517017:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408420736 00000100:00100000:0.0:1789181429.517021:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408420736 00000100:00100000:0.0:1789181429.517039:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408421376 00000100:00100000:0.0:1789181429.517041:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408421376 00000100:00100000:0.0:1789181429.517055:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408421888 00000100:00100000:0.0:1789181429.517057:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408421888 00000100:00100000:0.0:1789181429.517069:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408420992 00000100:00100000:0.0:1789181429.517071:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408420992 00000100:00100000:0.0:1789181429.517095:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789181429.517101:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408420736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181429.517789:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408421248:0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.521131:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408420608:12345-0@lo:400:kworker.0 Request processed in 4192us (4934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181429.521148:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789181429.521290:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789181429.521304:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408421376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.521361:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408421376:12345-0@lo:400:kworker.0 Request processed in 63us (4998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181429.521384:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789181429.521404:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789181429.521411:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408421888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.521445:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408421888:12345-0@lo:400:kworker.0 Request processed in 35us (5052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181429.521451:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789181429.521463:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789181429.521469:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408420992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.521500:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408420992:12345-0@lo:400:kworker.0 Request processed in 32us (5068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181429.521506:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789181429.521536:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408421632 00000100:00100000:1.0:1789181429.521544:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408421632 00000100:00100000:1.0:1789181429.521578:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408422144 00000100:00100000:1.0:1789181429.521581:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408422144 00000100:00100000:1.0:1789181429.521667:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408421504 00000100:00100000:1.0:1789181429.521671:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408421504 00000100:00100000:1.0:1789181429.521685:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408422016 00000100:00100000:1.0:1789181429.521688:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408422016 00000100:00100000:1.0:1789181429.521790:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789181429.521799:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408421632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.521834:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408421632:12345-0@lo:400:kworker.0 Request processed in 38us (5502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181429.521841:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789181429.521853:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789181429.521859:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408422144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.521903:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408422144:12345-0@lo:400:kworker.0 Request processed in 44us (5541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181429.521923:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789181429.521937:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789181429.521942:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408421504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.521970:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408421504:12345-0@lo:400:kworker.0 Request processed in 28us (5504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181429.521975:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789181429.521986:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789181429.521991:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876092408422016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.522018:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876092408422016:12345-0@lo:400:kworker.0 Request processed in 27us (5521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181429.522023:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1789181429.522044:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181429.522049:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181429.522051:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181429.522149:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789181429.522157:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1de7f64700, transno 4294967301 00000100:00100000:1.0:1789181429.522185:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408420480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181429.522200:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408420992:0@lo:400:kworker.0 00010000:00080000:1.0:1789181429.522287:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb2a8a80 x1876092408421504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181429.522299:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408421504:0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.522314:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408422016:0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.522340:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408421120:0@lo:400:kworker.0 00010000:00080000:1.0:1789181429.522351:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3896300 x1876092408421632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181429.522359:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408421632:0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.522367:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408422144:0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.522378:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408420608:0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.522442:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408422272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181429.522454:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408420864:0@lo:400:kworker.0 00010000:00080000:1.0:1789181429.522466:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb2a9180 x1876092408421376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181429.522475:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408421376:0@lo:400:kworker.0 00010000:00080000:1.0:1789181429.522486:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3894a80 x1876092408421888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181429.522494:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408421888:0@lo:400:kworker.0 00000100:00100000:0.0:1789181429.523415:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408420736:12345-0@lo:400:kworker.0 Request processed in 6309us (7197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181429.523427:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789181429.528575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181429.528743:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408421760:0@lo:400:kworker.0 00000100:00100000:2.0:1789181429.528789:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181429.528822:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408421248 00000100:00100000:1.0:1789181429.528831:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408421248 00000100:00100000:2.0:1789181429.528851:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408420736:0@lo:400:kworker.0 00000100:00100000:1.0:1789181429.528886:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408421760 00000100:00100000:1.0:1789181429.528889:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408421760 00000100:00100000:1.0:1789181429.528911:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789181429.528920:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408421248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181429.529010:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789181429.529020:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408421760:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789181429.529429:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181429.531956:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408422272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 15305us (15511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181429.532128:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789181429.532512:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408421248:12345-0@lo:400:kworker.0 Request processed in 3590us (3942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181429.532541:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789181429.539013:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408421248:0@lo:400:kworker.0 00000100:00100000:2.0:1789181429.539046:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408421760:0@lo:400:kworker.0 00000100:00100000:0.0:1789181429.545063:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408421760:12345-0@lo:400:kworker.0 Request processed in 9428us (9655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181429.545088:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00010000:00010000:1.0:1789181430.284067:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181431.309189:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181431.564032:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408422400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181431.564139:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181431.564283:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408422400 00000100:00100000:0.0:1789181431.564294:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408422400 00000100:00100000:0.0:1789181431.564350:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789181431.564361:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408422400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789181431.564397:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789181431.564763:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408422400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 403us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181431.564771:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789181431.564857:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408422400:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789181432.338451:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181433.100340:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408422528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181433.100417:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181433.100596:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408422528 00000100:00100000:0.0:1789181433.100604:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408422528 00000100:00100000:0.0:1789181433.100670:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789181433.100681:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408422528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181433.100712:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181433.100778:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408422528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181433.100785:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1789181433.100825:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd8ba3800 x1876092408422528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181433.100845:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408422528:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789181433.102574:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181433.103292:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181433.103313:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408422656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181433.103385:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181433.103480:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408422656 00000100:00100000:1.0:1789181433.103488:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408422656 00000100:00100000:1.0:1789181433.103544:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789181433.103550:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408422656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181433.103567:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181433.103600:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408422656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181433.103605:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789181433.103663:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181433.103825:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3896300 x1876092408422656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181433.103839:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408422656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181433.195710:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181433.195799:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181433.195901:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181433.195958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385260800 00000100:00100000:2.0:1789181433.195968:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385260800 00000100:00100000:2.0:1789181433.198188:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 374 00000100:00100000:2.0:1789181433.198211:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385260800:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181433.198294:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385260800:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 93us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181433.198302:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 374 00000100:00100000:1.0:1789181433.212373:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181433.216626:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385260928 00000100:00100000:3.0:1789181433.216641:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385260928 00000100:00100000:3.0:1789181433.216745:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385261056 00000100:00100000:3.0:1789181433.216749:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385261056 00000100:00100000:3.0:1789181433.216778:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:3.0:1789181433.216791:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385260928:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181433.216908:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385260928:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 120us (21108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181433.216915:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:3.0:1789181433.216933:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:3.0:1789181433.216940:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385261056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181433.216984:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385261056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 44us (21082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181433.216990:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:1.0:1789181433.218202:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181433.218238:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181433.218264:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385261184 00000100:00100000:1.0:1789181433.218271:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385261184 00000100:00100000:1.0:1789181433.218317:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:1.0:1789181433.218325:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385261184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181433.218379:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385261184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181433.218387:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:0.0:1789181433.219008:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385261312 00000100:00100000:0.0:1789181433.219015:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385261312 00000100:00100000:0.0:1789181433.219057:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385261440 00000100:00100000:0.0:1789181433.219060:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385261440 00000100:00100000:0.0:1789181433.219078:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:0.0:1789181433.219086:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385261312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181433.219138:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385261312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 52us (6774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181433.219145:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:0.0:1789181433.219160:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00100000:0.0:1789181433.219167:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385261440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181433.219190:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385261440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181433.219195:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00080000:0.0:1789181433.219213:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181433.219217:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789181433.219219:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789181433.356119:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181433.357481:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789181433.430100:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789181434.124079:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181434.124113:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408422784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181434.124187:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181434.125759:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408422784 00000100:00100000:3.0:1789181434.125771:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408422784 00000100:00100000:3.0:1789181434.125841:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789181434.125851:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408422784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181434.125891:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789181434.125973:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408422784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181434.125981:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789181434.126285:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408422784:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789181434.380267:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181434.636354:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408423168:0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.636430:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181434.636491:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408423680:0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.636515:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181434.636533:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408424192:0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.636574:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181434.636600:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789181434.636606:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408423040:0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.636647:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181434.636670:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408423552:0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.636691:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181434.636707:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408424064:0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.636749:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181434.636778:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408423040 00000100:00100000:1.0:1789181434.636785:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408423040 00000100:00100000:1.0:1789181434.636829:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789181434.636839:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408423040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.636892:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408423040:12345-0@lo:400:kworker.0 Request processed in 53us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181434.636905:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789181434.636939:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408423168 00000100:00100000:1.0:1789181434.636944:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408423168 00000100:00100000:1.0:1789181434.636962:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408423680 00000100:00100000:1.0:1789181434.636965:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408423680 00000100:00100000:1.0:1789181434.636986:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408424192 00000100:00100000:1.0:1789181434.636989:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408424192 00000100:00100000:1.0:1789181434.636999:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408423552 00000100:00100000:1.0:1789181434.637001:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408423552 00000100:00100000:1.0:1789181434.637012:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408424064 00000100:00100000:1.0:1789181434.637014:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408424064 00000100:00100000:1.0:1789181434.637026:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789181434.637046:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408423168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.637081:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408423168:12345-0@lo:400:kworker.0 Request processed in 49us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181434.637087:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789181434.637098:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789181434.637103:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408423680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.637129:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408423680:12345-0@lo:400:kworker.0 Request processed in 25us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181434.637135:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789181434.637146:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789181434.637151:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408424192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.637177:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408424192:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181434.637183:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789181434.637202:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789181434.637215:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408423552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.637243:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408423552:12345-0@lo:400:kworker.0 Request processed in 29us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181434.637248:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789181434.637261:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789181434.637267:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408424064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.637291:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408424064:12345-0@lo:400:kworker.0 Request processed in 25us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181434.637297:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789181434.637328:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408423040:0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.637340:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408423552:0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.637348:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408424064:0@lo:400:kworker.0 00000100:00100000:1.0:1789181434.637356:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408423168:0@lo:400:kworker.0 00010000:00080000:1.0:1789181434.637366:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3209f80 x1876092408423680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181434.637376:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408423680:0@lo:400:kworker.0 00010000:00080000:1.0:1789181434.637385:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb2a9180 x1876092408424192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181434.637393:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408424192:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.637600:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408423296:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.637633:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181434.637663:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408423808:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.637686:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181434.637701:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408424320:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.637721:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181434.637764:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789181434.637771:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408422912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181434.637794:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181434.637811:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408423424:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.637829:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181434.637841:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408423936:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.637855:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181434.637880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408424448:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.637900:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181434.637925:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408423424 00000100:00100000:0.0:1789181434.637930:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408423424 00000100:00100000:0.0:1789181434.637956:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789181434.637962:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408423424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.637999:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408423424:12345-0@lo:400:kworker.0 Request processed in 37us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181434.638005:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789181434.638024:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408423808 00000100:00100000:0.0:1789181434.638027:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408423808 00000100:00100000:0.0:1789181434.638055:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408424320 00000100:00100000:0.0:1789181434.638059:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408424320 00000100:00100000:0.0:1789181434.638072:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408423936 00000100:00100000:0.0:1789181434.638074:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408423936 00000100:00100000:0.0:1789181434.638083:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408424448 00000100:00100000:0.0:1789181434.638085:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408424448 00000100:00100000:0.0:1789181434.638098:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789181434.638104:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408423808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.638136:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408423808:12345-0@lo:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181434.638142:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789181434.638152:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789181434.638158:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408424320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.638184:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408424320:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181434.638188:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789181434.638198:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789181434.638210:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408423936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.638237:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408423936:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181434.638242:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789181434.638251:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789181434.638256:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408424448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.638284:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408424448:12345-0@lo:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181434.638288:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1789181434.638303:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181434.638307:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181434.638309:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181434.638324:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408423296 00000100:00100000:0.0:1789181434.638326:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408423296 00000100:00100000:0.0:1789181434.638346:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789181434.638351:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408423296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.638377:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408423296:12345-0@lo:400:kworker.0 Request processed in 26us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181434.638382:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789181434.638410:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408423424:0@lo:400:kworker.0 00010000:00080000:0.0:1789181434.638420:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3209880 x1876092408423936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181434.638427:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408423936:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.638436:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408424448:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.638444:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408423296:0@lo:400:kworker.0 00010000:00080000:0.0:1789181434.638463:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3208e00 x1876092408423808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181434.638471:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408423808:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.638478:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408424320:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.638501:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408422912 00000100:00100000:0.0:1789181434.638504:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408422912 00000100:00100000:0.0:1789181434.638528:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789181434.638536:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408422912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181434.638555:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181434.638589:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408422912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181434.638595:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789181434.638624:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408422912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181434.638641:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408424576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181434.638662:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181434.638685:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408424576 00000100:00100000:0.0:1789181434.638689:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408424576 00000100:00100000:0.0:1789181434.638709:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789181434.638714:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408424576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181434.638743:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181434.638772:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408424576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181434.638777:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789181434.638801:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408424576:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789181435.403923:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181436.428345:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181436.684076:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408424704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181436.684149:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181436.684842:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408424704 00000100:00100000:3.0:1789181436.684851:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408424704 00000100:00100000:3.0:1789181436.684915:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789181436.684925:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408424704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181436.684960:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789181436.685037:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408424704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181436.685044:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789181436.685184:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408424704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789181437.452299:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181438.220150:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408424832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789181438.220226:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181438.220272:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408424832 00000100:00100000:0.0:1789181438.220281:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408424832 00000100:00100000:2.0:1789181438.220298:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181438.220304:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408424960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181438.220334:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789181438.220344:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181438.220344:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408424832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181438.220373:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181438.220374:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789181438.220382:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1789181438.220418:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408424832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181438.220426:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789181438.220440:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408424960 00000100:00100000:0.0:1789181438.220444:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408424960 00000100:00100000:0.0:1789181438.220458:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789181438.220463:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408424960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181438.220474:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1789181438.220477:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd8ba0000 x1876092408424832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181438.220496:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408424832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181438.220496:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408424960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181438.220501:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1789181438.220517:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff905180 x1876092408424960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181438.220528:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408424960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789181438.220672:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181438.313629:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181438.313718:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181438.313830:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181438.314043:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385261824 00000100:00100000:3.0:1789181438.314057:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385261824 00000100:00100000:3.0:1789181438.314238:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385261696 00000100:00100000:3.0:1789181438.314243:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385261696 00000100:00100000:3.0:1789181438.314276:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 263 00000100:00100000:3.0:1789181438.314308:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385261824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181438.314408:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385261824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 103us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181438.314417:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 263 00000100:00100000:3.0:1789181438.314437:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 264 00000100:00100000:3.0:1789181438.314443:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385261696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181438.314475:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385261696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181438.314482:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 264 00000100:00100000:2.0:1789181438.314808:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385261568 00000100:00100000:2.0:1789181438.314815:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385261568 00000100:00100000:2.0:1789181438.314878:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 376 00000100:00100000:2.0:1789181438.314887:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385261568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181438.314923:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385261568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181438.314938:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 376 00000100:00080000:1.0:1789181438.315277:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181438.315282:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181438.326586:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181438.326763:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385261952 00000100:00100000:1.0:1789181438.326776:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385261952 00000100:00100000:1.0:1789181438.326864:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1789181438.326876:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2392:x1876092385261952:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:1.0:1789181438.326912:0:8629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb5552835171d2 00000100:00080000:1.0:1789181438.326923:0:8629:0:(import.c:65:import_set_state_nolock()) ffff9c1cc3a2e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789181438.326980:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:3.0:1789181438.327084:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181438.327124:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181438.327219:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181438.327246:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385262080 00000100:00100000:3.0:1789181438.327252:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385262080 00000100:00100000:3.0:1789181438.327303:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385262208 00000100:00100000:3.0:1789181438.327307:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385262208 00000100:00100000:3.0:1789181438.327346:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 265 00000100:00100000:3.0:1789181438.327354:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385262080:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181438.327424:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385262080:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 70us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181438.327432:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 265 00000100:00100000:3.0:1789181438.327449:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 266 00000100:00100000:3.0:1789181438.327456:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385262208:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181438.327482:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385262208:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181438.327508:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 266 00000100:00100000:1.0:1789181438.328167:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+2:2392:x1876092385261952:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 1289us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181438.328177:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00080000:2.0:1789181438.332306:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181438.332320:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181438.332325:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789181438.477201:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181439.244154:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181439.244182:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408425088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181439.244276:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181439.244367:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408425088 00000100:00100000:3.0:1789181439.244378:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408425088 00000100:00100000:3.0:1789181439.244455:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789181439.244467:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408425088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181439.244510:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789181439.244579:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408425088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181439.244587:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789181439.244646:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408425088:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789181439.502301:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181439.756038:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181439.756065:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408425600:0@lo:400:kworker.0 00000100:00100000:0.0:1789181439.756137:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181439.756215:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408425344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181439.756247:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181439.756274:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408426112:0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.756286:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408425472:0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.756332:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181439.756338:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181439.756406:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408425216:0@lo:400:kworker.0 00000100:00100000:1.0:1789181439.756598:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408425344 00000100:00100000:1.0:1789181439.756607:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408425344 00000100:00100000:1.0:1789181439.756664:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789181439.756674:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408425344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181439.756703:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181439.759192:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408425984:0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.759381:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181439.759425:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408426368:0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.759474:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181439.759599:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408426112 00000100:00100000:3.0:1789181439.759609:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408426112 00000100:00100000:3.0:1789181439.759660:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789181439.759671:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408426112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.759740:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408426112:12345-0@lo:400:kworker.0 Request processed in 53us (3387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181439.759748:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789181439.759775:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408425600 00000100:00100000:3.0:1789181439.759779:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408425600 00000100:00100000:3.0:1789181439.759798:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408425472 00000100:00100000:3.0:1789181439.759807:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408425472 00000100:00100000:3.0:1789181439.759821:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408425984 00000100:00100000:3.0:1789181439.759823:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408425984 00000100:00100000:3.0:1789181439.759837:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408426368 00000100:00100000:3.0:1789181439.759839:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408426368 00000100:00100000:3.0:1789181439.759854:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789181439.759860:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408425600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.759894:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408425600:12345-0@lo:400:kworker.0 Request processed in 35us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181439.759901:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789181439.759912:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789181439.759918:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408425472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.760473:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408425472:12345-0@lo:400:kworker.0 Request processed in 552us (4140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181439.760481:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789181439.760498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789181439.760506:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408425984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.760553:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408425984:12345-0@lo:400:kworker.0 Request processed in 49us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181439.760559:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789181439.760572:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789181439.760580:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408426368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.760612:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408426368:12345-0@lo:400:kworker.0 Request processed in 34us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181439.760618:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789181439.760669:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408426368:0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.760696:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408425472:0@lo:400:kworker.0 00010000:00080000:3.0:1789181439.760709:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff904700 x1876092408425984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181439.760739:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408425984:0@lo:400:kworker.0 00000100:00080000:3.0:1789181439.760789:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181439.760793:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181439.760796:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789181439.765034:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff904000 x1876092408426112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181439.765056:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408426112:0@lo:400:kworker.0 00000100:00100000:0.0:1789181439.765074:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408425600:0@lo:400:kworker.0 00000100:00100000:0.0:1789181439.765112:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408426624:0@lo:400:kworker.0 00000100:00100000:2.0:1789181439.767795:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181439.767874:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408425856:0@lo:400:kworker.0 00000100:00100000:0.0:1789181439.767919:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181439.767946:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181439.767966:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789181439.767977:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408426496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181439.767979:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408425728:0@lo:400:kworker.0 00000100:00100000:0.0:1789181439.768028:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181439.768055:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408426240:0@lo:400:kworker.0 00000100:00100000:2.0:1789181439.768056:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181439.768092:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181439.768127:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408426624 00000100:00100000:0.0:1789181439.768128:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408426240 00000100:00100000:2.0:1789181439.768138:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408426624 00000100:00100000:0.0:1789181439.768139:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408426240 00000100:00100000:2.0:1789181439.768190:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408425856 00000100:00100000:2.0:1789181439.768194:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408425856 00000100:00100000:2.0:1789181439.768215:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789181439.768223:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408426624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181439.768287:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408426624:12345-0@lo:400:kworker.0 Request processed in 64us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181439.768294:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789181439.768311:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789181439.768317:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408425856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181439.768352:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408425856:12345-0@lo:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181439.768359:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1789181439.768375:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181439.768812:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181439.768848:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408425856:0@lo:400:kworker.0 00000100:00100000:2.0:1789181439.768890:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408426496 00000100:00100000:2.0:1789181439.768894:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408426496 00000100:00080000:2.0:1789181439.768912:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181439.768937:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789181439.768945:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408426496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789181439.768961:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181439.769011:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408426496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181439.769018:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789181439.769062:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408426496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181439.769314:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408425216 00000100:00100000:3.0:1789181439.769319:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408425216 00000100:00100000:3.0:1789181439.769354:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789181439.769362:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408425216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181439.769395:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789181439.769407:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408426240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.769429:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408425216:12345-0@lo:400:kworker.0 Request processed in 67us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181439.769436:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789181439.769464:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408426240:12345-0@lo:400:kworker.0 Request processed in 60us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181439.769471:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789181439.769502:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408425728 00000100:00100000:3.0:1789181439.769507:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408425728 00000100:00100000:3.0:1789181439.769532:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789181439.769539:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408425728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.769575:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408425728:12345-0@lo:400:kworker.0 Request processed in 36us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181439.769581:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789181439.769923:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408425216:0@lo:400:kworker.0 00010000:00080000:0.0:1789181439.770435:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff907100 x1876092408426240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181439.770448:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408426240:0@lo:400:kworker.0 00000100:00100000:0.0:1789181439.770457:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408426752:0@lo:400:kworker.0 00000100:00100000:0.0:1789181439.770494:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181439.770552:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408426752 00000100:00100000:0.0:1789181439.770557:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408426752 00000100:00100000:0.0:1789181439.770602:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789181439.770622:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181439.770663:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408426752:12345-0@lo:400:kworker.0 Request processed in 54us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181439.770683:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789181439.770714:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408426752:0@lo:400:kworker.0 00010000:00080000:0.0:1789181439.770756:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff905880 x1876092408426624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181439.770766:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408426624:0@lo:400:kworker.0 00000100:00100000:0.0:1789181439.770788:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408425728:0@lo:400:kworker.0 00000100:00100000:1.0:1789181439.791279:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408425344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34593us (35017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181439.791298:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789181439.791394:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408425344:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789181440.527630:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181441.548168:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181441.805150:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181441.805176:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408426880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181441.805248:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181441.805323:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408426880 00000100:00100000:3.0:1789181441.805338:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408426880 00000100:00100000:3.0:1789181441.805383:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789181441.805392:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408426880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181441.805422:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789181441.805465:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408426880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181441.805472:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789181441.805514:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408426880:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789181442.579251:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181443.346034:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408427008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181443.346173:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181443.346231:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408427136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181443.346412:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181443.346442:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408427008 00000100:00100000:3.0:1789181443.346451:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408427008 00000100:00100000:0.0:1789181443.346472:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408427136 00000100:00100000:0.0:1789181443.346477:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408427136 00000100:00100000:0.0:1789181443.346511:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789181443.346518:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408427008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181443.346545:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181443.346590:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408427008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (417us total) trans 0 rc 0/0 00000100:00080000:2.0:1789181443.354892:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181443.359015:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789181443.359034:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789181443.359045:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408427136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181443.359077:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181443.359180:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408427136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (12770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181443.359186:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:0.0:1789181443.359263:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd8ba2d80 x1876092408427136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181443.359294:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408427136:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789181443.359494:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff853b80 x1876092408427008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181443.359511:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408427008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181443.429792:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181443.429838:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181443.429866:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181443.429888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181443.429919:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181443.430009:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385262592 00000100:00100000:0.0:1789181443.430021:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385262848 00000100:00100000:3.0:1789181443.430023:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385262592 00000100:00100000:0.0:1789181443.430038:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385262848 00000100:00100000:3.0:1789181443.430104:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385262464 00000100:00100000:3.0:1789181443.430108:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385262464 00000100:00100000:2.0:1789181443.430183:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385262336 00000100:00100000:2.0:1789181443.430189:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385262336 00000100:00100000:2.0:1789181443.430230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 378 00000100:00100000:2.0:1789181443.430256:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385262336:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181443.430352:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385262336:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 111us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181443.430360:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 378 00000100:00080000:2.0:1789181443.430414:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181443.430419:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181443.430429:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385262720 00000100:00100000:2.0:1789181443.430433:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385262720 00000100:00100000:0.0:1789181443.430487:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 273 00000100:00100000:0.0:1789181443.430497:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385262592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181443.430533:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385262592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181443.430540:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 273 00000100:00100000:3.0:1789181443.440820:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 274 00000100:00100000:3.0:1789181443.440839:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385262848:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181443.440914:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385262848:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 83us (11048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181443.440922:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 274 00000100:00100000:3.0:1789181443.440944:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 275 00000100:00100000:3.0:1789181443.440964:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385262464:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181443.440990:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385262464:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 39us (11102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181443.440997:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 275 00000100:00100000:2.0:1789181443.443163:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 276 00000100:00100000:2.0:1789181443.443184:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385262720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181443.443271:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385262720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 96us (13351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181443.443280:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 276 00000100:00080000:2.0:1789181443.443316:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789181443.600314:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789181443.604603:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181443.664694:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1789181443.857246:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:0.0:1789181443.857257:0:9516:0:(genops.c:885:class_export_put()) final put ffff9c1cc3a2c000/3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:0.0:1789181443.857283:0:12254:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc3a2c000/3c4ab02e-ed68-4ee0-b458-d9073baffb59 for lustre-OST0001 00000020:00000080:0.0:1789181443.857342:0:12254:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc3a2e000 for lustre-OST0001 00000100:00100000:0.0:1789181444.363932:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181444.363964:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408427264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181444.364036:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181444.364230:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408427264 00000100:00100000:2.0:1789181444.364240:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408427264 00000100:00100000:2.0:1789181444.364287:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789181444.364297:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408427264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789181444.364341:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789181444.364390:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408427264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181444.364404:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789181444.364462:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408427264:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789181444.624895:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181444.875853:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181444.875876:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408427392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181444.875953:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181444.876019:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408427392 00000100:00100000:0.0:1789181444.876027:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408427392 00000100:00100000:0.0:1789181444.876100:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789181444.876110:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408427392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181444.876138:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181444.876192:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408427392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181444.876200:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789181444.876261:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408427392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181444.877151:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408427904:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.877205:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.877230:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408428416:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.877267:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.877285:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789181444.877290:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408427520:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.877316:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.877337:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408428032:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.877359:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.877376:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408428544:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.877395:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.877434:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408427904 00000100:00100000:3.0:1789181444.877439:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408427904 00000100:00100000:3.0:1789181444.877486:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789181444.877494:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408427904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.877537:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408427904:12345-0@lo:400:kworker.0 Request processed in 44us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181444.877545:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789181444.877756:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408427520 00000100:00100000:3.0:1789181444.877760:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408427520 00000100:00100000:3.0:1789181444.877788:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789181444.877794:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408427520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.877826:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408427520:12345-0@lo:400:kworker.0 Request processed in 32us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181444.877832:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789181444.877858:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408428032 00000100:00100000:3.0:1789181444.877861:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408428032 00000100:00100000:3.0:1789181444.877888:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408428544 00000100:00100000:3.0:1789181444.877891:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408428544 00000100:00100000:3.0:1789181444.877912:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789181444.877918:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408428032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.877959:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408428032:12345-0@lo:400:kworker.0 Request processed in 41us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181444.877964:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789181444.877977:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789181444.877983:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408428544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.878009:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408428544:12345-0@lo:400:kworker.0 Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181444.878025:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789181444.878134:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408427520:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.878149:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408428032:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.878159:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408428544:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.878169:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408427904:0@lo:400:kworker.0 00000100:00100000:0.0:1789181444.878426:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408428416 00000100:00100000:0.0:1789181444.878431:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408428416 00000100:00100000:0.0:1789181444.878469:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789181444.878476:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408428416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181444.878520:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408428416:12345-0@lo:400:kworker.0 Request processed in 44us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181444.878525:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1789181444.878570:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff906680 x1876092408428416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181444.878582:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408428416:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.879350:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408427648:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.879394:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.879425:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408428160:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.879445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.879537:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408428672:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.879914:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.880382:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789181444.880393:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408427776:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.880549:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.880675:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408428288:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.880785:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.880806:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408428800:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.880828:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789181444.880861:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181444.880867:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181444.880882:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408427648 00000100:00100000:3.0:1789181444.880890:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408427648 00000100:00100000:3.0:1789181444.880925:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408428160 00000100:00100000:3.0:1789181444.880951:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408428160 00000100:00100000:3.0:1789181444.880980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408428672 00000100:00100000:3.0:1789181444.880983:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408428672 00000100:00100000:3.0:1789181444.880996:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408427776 00000100:00100000:3.0:1789181444.880998:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408427776 00000100:00100000:3.0:1789181444.881012:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789181444.881021:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408427648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.881220:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789181444.881230:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408428160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.881384:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408428160:12345-0@lo:400:kworker.0 Request processed in 156us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181444.881392:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789181444.881425:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789181444.881432:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408428672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.881693:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408428672:12345-0@lo:400:kworker.0 Request processed in 262us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181444.881785:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789181444.881800:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789181444.881807:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408427776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.881839:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408427776:12345-0@lo:400:kworker.0 Request processed in 33us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181444.881845:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:2.0:1789181444.882009:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181444.882047:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408427776:0@lo:400:kworker.0 00000100:00100000:0.0:1789181444.882497:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408428288 00000100:00100000:0.0:1789181444.882504:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408428288 00000100:00100000:0.0:1789181444.882548:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408428800 00000100:00100000:0.0:1789181444.882552:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408428800 00000100:00100000:1.0:1789181444.882836:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789181444.882848:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408428288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181444.882905:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408428288:12345-0@lo:400:kworker.0 Request processed in 60us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181444.882911:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789181444.883008:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789181444.883015:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408428800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181444.883050:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408428800:12345-0@lo:400:kworker.0 Request processed in 37us (2221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181444.883056:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789181444.883169:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181444.883182:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408428928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181444.883220:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181444.883268:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408428928 00000100:00100000:0.0:1789181444.883272:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408428928 00000100:00100000:0.0:1789181444.883297:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789181444.883304:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408428928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181444.883319:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181444.883354:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408428928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181444.883359:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789181444.883395:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408428928:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789181444.883464:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181444.887400:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408427648:12345-0@lo:400:kworker.0 Request processed in 6369us (7994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181444.887415:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00080000:2.0:1789181444.887850:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff904a80 x1876092408428160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181444.887869:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408428160:0@lo:400:kworker.0 00010000:00080000:2.0:1789181444.887896:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff904700 x1876092408428672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181444.887924:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408428672:0@lo:400:kworker.0 00010000:00080000:2.0:1789181444.887971:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff907480 x1876092408428288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181444.887981:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408428288:0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.887993:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408428800:0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.888006:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408427648:0@lo:400:kworker.0 00010000:00010000:1.0:1789181445.661269:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181446.669260:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181446.924965:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181446.924990:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408429056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181446.925064:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181446.925503:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408429056 00000100:00100000:2.0:1789181446.925511:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408429056 00000100:00100000:2.0:1789181446.925566:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789181446.925576:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408429056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789181446.925612:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789181446.926302:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408429056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 714us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181446.926311:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789181446.931774:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408429056:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789181447.702148:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789181448.234219:0:14064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:50:46 (1789181446) 00000100:00100000:0.0:1789181448.463558:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181448.463583:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408429184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181448.463659:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181448.463753:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408429184 00000100:00100000:0.0:1789181448.463763:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408429184 00000100:00100000:0.0:1789181448.463818:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789181448.463829:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408429184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181448.463862:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181448.463922:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408429184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181448.463930:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1789181448.463954:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181448.463990:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3a79880 x1876092408429184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181448.464008:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408429184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181448.464571:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181448.464583:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408429312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181448.464619:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181448.466892:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408429312 00000100:00100000:0.0:1789181448.466941:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408429312 00000100:00100000:0.0:1789181448.467026:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789181448.467038:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408429312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181448.467088:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181448.467252:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408429312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 217us (2631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181448.467269:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1789181448.473051:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3a79880 x1876092408429312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181448.473079:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408429312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181448.477927:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181448.555051:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181448.555118:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181448.555144:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181448.555166:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181448.555190:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181448.555215:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385263232 00000100:00100000:3.0:1789181448.555226:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385263232 00000100:00100000:2.0:1789181448.555495:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385262976 00000100:00100000:2.0:1789181448.555500:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385262976 00000100:00100000:2.0:1789181448.555533:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 380 00000100:00100000:2.0:1789181448.555543:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385262976:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181448.555614:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385262976:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 73us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181448.555622:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 380 00000100:00100000:2.0:1789181448.555655:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385263104 00000100:00100000:2.0:1789181448.555679:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385263104 00000100:00100000:2.0:1789181448.555700:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385263360 00000100:00100000:2.0:1789181448.555703:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385263360 00000100:00100000:2.0:1789181448.555717:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 283 00000100:00100000:2.0:1789181448.555743:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385263232:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181448.555779:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385263232:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 55us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181448.555785:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 283 00000100:00100000:2.0:1789181448.555799:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 284 00000100:00100000:2.0:1789181448.555805:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385263104:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181448.555831:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385263104:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181448.555838:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 284 00000100:00100000:2.0:1789181448.555849:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 285 00000100:00100000:2.0:1789181448.555855:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385263360:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181448.555878:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385263360:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181448.555883:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 285 00000100:00100000:3.0:1789181448.556070:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385263488 00000100:00100000:3.0:1789181448.556074:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385263488 00000100:00100000:3.0:1789181448.556109:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 286 00000100:00100000:3.0:1789181448.556117:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385263488:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181448.556151:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385263488:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181448.556164:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 286 00000100:00080000:3.0:1789181448.556190:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181448.556195:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789181448.715925:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181449.483961:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181449.483983:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408429440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181449.484063:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181449.484183:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408429440 00000100:00100000:3.0:1789181449.484192:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408429440 00000100:00100000:3.0:1789181449.484239:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789181449.484248:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408429440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181449.484281:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789181449.484328:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408429440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.484335:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789181449.484390:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408429440:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789181449.741572:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181449.996037:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181449.996058:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408429696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181449.996120:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181449.996199:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408429696 00000100:00100000:2.0:1789181449.996207:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408429696 00000100:00100000:2.0:1789181449.996258:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789181449.996268:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408429696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789181449.996311:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181449.996355:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408429696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181449.996363:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789181449.996425:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408429696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181449.997081:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181449.997096:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408429568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181449.997135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181449.997280:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408430208:0@lo:400:kworker.0 00000100:00100000:1.0:1789181449.997309:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181449.997327:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408430720:0@lo:400:kworker.0 00000100:00100000:1.0:1789181449.997352:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181449.997372:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789181449.997377:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408429824:0@lo:400:kworker.0 00000100:00100000:1.0:1789181449.997781:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181449.997807:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408430336:0@lo:400:kworker.0 00000100:00100000:1.0:1789181449.997835:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181449.997861:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408430848:0@lo:400:kworker.0 00000100:00100000:1.0:1789181449.997884:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181449.997926:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408430720 00000100:00100000:1.0:1789181449.997934:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408430720 00000100:00100000:3.0:1789181449.998119:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408430080:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.998149:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181449.998170:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408430592:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.998190:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181449.998215:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789181449.998221:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408429952:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.998244:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181449.998259:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408430464:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.998280:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181449.998291:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408430976:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.998310:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789181449.998329:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181449.998346:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408429824 00000100:00100000:3.0:1789181449.998358:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408429824 00000100:00100000:3.0:1789181449.998398:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789181449.998421:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408429824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.998798:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3645:x1876092408429824:12345-0@lo:400:kworker.0 Request processed in 391us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.998806:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789181449.998843:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408430336 00000100:00100000:3.0:1789181449.998847:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408430336 00000100:00100000:3.0:1789181449.998873:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408430848 00000100:00100000:3.0:1789181449.998875:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408430848 00000100:00100000:3.0:1789181449.998886:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408430080 00000100:00100000:3.0:1789181449.998901:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408430080 00000100:00100000:3.0:1789181449.998913:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408429952 00000100:00100000:3.0:1789181449.998915:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408429952 00000100:00100000:3.0:1789181449.998925:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408430464 00000100:00100000:3.0:1789181449.998927:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408430464 00000100:00100000:3.0:1789181449.998940:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408430976 00000100:00100000:3.0:1789181449.998942:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408430976 00000100:00100000:3.0:1789181449.998968:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789181449.998975:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408430336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.999011:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408430336:12345-0@lo:400:kworker.0 Request processed in 37us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.999017:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789181449.999030:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789181449.999036:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408430848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.999062:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408430848:12345-0@lo:400:kworker.0 Request processed in 27us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.999068:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789181449.999079:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789181449.999090:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408430080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.999121:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408430080:12345-0@lo:400:kworker.0 Request processed in 31us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.999126:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789181449.999137:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789181449.999142:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408429952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.999166:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408429952:12345-0@lo:400:kworker.0 Request processed in 24us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.999171:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789181449.999182:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789181449.999187:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408430464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.999211:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408430464:12345-0@lo:400:kworker.0 Request processed in 25us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.999217:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789181449.999228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789181449.999233:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408430976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.999260:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408430976:12345-0@lo:400:kworker.0 Request processed in 27us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.999265:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789181449.999290:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408430592 00000100:00100000:3.0:1789181449.999294:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408430592 00000100:00100000:3.0:1789181449.999317:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789181449.999323:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408430592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.999351:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408430592:12345-0@lo:400:kworker.0 Request processed in 29us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.999366:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1789181449.999381:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181449.999385:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181449.999425:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408429952:0@lo:400:kworker.0 00010000:00080000:3.0:1789181449.999440:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff905880 x1876092408430464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181449.999450:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408430464:0@lo:400:kworker.0 00000100:00100000:0.0:1789181449.999809:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408429568 00000100:00100000:0.0:1789181449.999815:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408429568 00000100:00100000:0.0:1789181449.999854:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789181449.999861:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408429568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181449.999878:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181449.999930:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408429568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (2793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181449.999936:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1789181449.999969:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181450.000015:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408429568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181450.000106:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408430208 00000100:00100000:2.0:1789181450.000112:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408430208 00000100:00100000:2.0:1789181450.000149:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789181450.000157:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408430208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181450.000193:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408430208:12345-0@lo:400:kworker.0 Request processed in 38us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181450.000199:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789181450.000249:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408429824:0@lo:400:kworker.0 00000100:00100000:2.0:1789181450.000262:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408430336:0@lo:400:kworker.0 00000100:00100000:2.0:1789181450.000273:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408430848:0@lo:400:kworker.0 00000100:00100000:2.0:1789181450.000283:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408430208:0@lo:400:kworker.0 00000100:00100000:1.0:1789181450.000804:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789181450.000822:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408430720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181450.000869:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408430720:12345-0@lo:400:kworker.0 Request processed in 57us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181450.000874:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1789181450.001038:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789181450.001122:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff905f80 x1876092408430720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181450.001135:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408430720:0@lo:400:kworker.0 00010000:00080000:3.0:1789181450.001316:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff907100 x1876092408430976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181450.001328:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408430976:0@lo:400:kworker.0 00000100:00100000:3.0:1789181450.001345:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408430080:0@lo:400:kworker.0 00010000:00080000:3.0:1789181450.001355:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff906680 x1876092408430592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181450.001362:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408430592:0@lo:400:kworker.0 00000100:00100000:0.0:1789181450.144685:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181450.146296:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385263616 00000100:00100000:3.0:1789181450.146314:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385263616 00000100:00100000:3.0:1789181450.146412:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1789181450.146426:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:11082:x1876092385263616:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181450.146449:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1789181450.146655:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789181450.147065:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835172b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7ec0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181450.147142:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835172b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181450.147192:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835172b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181450.147209:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835172b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181450.147265:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789181450.147269:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181450.147316:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835172b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181450.147347:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835172b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ec0 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181450.147372:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835172b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ec0 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181450.147382:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc373f600) 00010000:00010000:3.0:1789181450.147386:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181450.147391:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f000, rc 0) 00000100:00100000:3.0:1789181450.148068:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:11082:x1876092385263616:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1643us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181450.148077:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1789181450.172492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181450.172614:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385263744 00000100:00100000:0.0:1789181450.172626:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385263744 00000100:00100000:0.0:1789181450.172704:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1789181450.172765:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:11083:x1876092385263744:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181450.172789:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181450.172810:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835172c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7ec7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.172876:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835172c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.172901:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835172c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.172914:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835172c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.172930:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.172937:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.172943:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173016:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679200/0x76fb5552835172d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173026:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679200/0x76fb5552835172d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173033:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679200/0x76fb5552835172d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181450.173087:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789181450.173091:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181450.173113:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679200/0x76fb5552835172d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173124:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835172c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173131:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835172c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173138:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835172c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173144:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181450.173148:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835172c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173156:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835172c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173169:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc373f600) 00010000:00010000:0.0:1789181450.173172:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181450.173178:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835172c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173185:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835172c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173202:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173220:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173226:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173231:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181450.173235:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173242:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173250:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c1dc6843600) 00010000:00010000:0.0:1789181450.173252:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181450.173255:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173260:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173293:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835172c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ec7 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173306:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679200/0x76fb5552835172d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ec7 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181450.173314:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1dc6843a00) 00010000:00010000:0.0:1789181450.173316:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181450.173325:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679200, rc 0) 00000100:00100000:0.0:1789181450.173450:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:11083:x1876092385263744:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 688us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181450.173459:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:2.0:1789181450.194184:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181450.194544:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385263872 00000100:00100000:3.0:1789181450.194557:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385263872 00000100:00100000:3.0:1789181450.194807:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1789181450.194821:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:11083:x1876092385263872:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789181450.194942:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:11083:x1876092385263872:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 Request processed in 124us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181450.194951:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1789181450.197557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181450.197814:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385264128 00000100:00100000:1.0:1789181450.197825:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385264128 00000100:00100000:1.0:1789181450.197903:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1789181450.197916:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:11083:x1876092385264128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181450.197939:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181450.197961:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb5552835172dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7ece expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198185:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835172e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198205:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835172e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198220:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835172e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198293:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835172ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198301:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835172ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198323:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835172ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198454:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb5552835172f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198462:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb5552835172f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198469:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb5552835172f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181450.198481:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789181450.198581:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835172e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198590:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835172e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198596:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835172e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198603:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181450.198607:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835172e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198616:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835172e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.198629:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1dc6843a00) 00010000:00010000:1.0:1789181450.198633:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181450.199404:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835172e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.199418:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb5552835172e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.199438:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835172ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.199445:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835172ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.199451:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835172ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.199457:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181450.199470:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835172ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.199480:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835172ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.199491:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c1dcf5c0a00) 00010000:00010000:1.0:1789181450.199494:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181450.199497:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835172ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.199503:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835172ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.201554:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb5552835172dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ece expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.201599:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb5552835172f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ece expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181450.201609:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:1.0:1789181450.201613:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181450.201615:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12e00, rc 0) 00000100:00100000:1.0:1789181450.201831:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:11083:x1876092385264128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 3916us (4282us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789181450.201840:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1789181450.211996:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181450.212974:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385264256 00000100:00100000:2.0:1789181450.212986:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385264256 00000100:00100000:2.0:1789181450.213354:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1789181450.213365:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:11083:x1876092385264256:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789181450.213522:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:11083:x1876092385264256:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 159us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181450.213530:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1789181450.225045:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181450.225776:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385264384 00000100:00100000:0.0:1789181450.225791:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385264384 00000100:00100000:0.0:1789181450.225872:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1789181450.225885:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:11083:x1876092385264384:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789181450.226476:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 531us 00000100:00080000:2.0:1789181450.227218:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181450.269255:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:11083:x1876092385264384:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 43361us (44209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181450.269270:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000040:00080000:1.0:1789181450.767435:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789181450.768477:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181450.831261:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789181451.789503:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181452.047117:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181452.047143:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408431104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789181452.047228:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181452.047423:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408431104 00000100:00100000:3.0:1789181452.047433:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408431104 00000100:00100000:3.0:1789181452.047496:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789181452.047508:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408431104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181452.047553:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789181452.047611:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408431104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181452.047618:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789181452.047788:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408431104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181452.640896:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181452.641193:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385264512 00000100:00100000:0.0:1789181452.641205:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385264512 00000100:00080000:3.0:1789181452.641355:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181452.655298:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1789181452.655328:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:11125:x1876092385264512:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181452.655353:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181452.655379:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7ed5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655447:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517306 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655463:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655494:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655511:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351730d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655518:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351730d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655526:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351730d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655579:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655588:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517306 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655594:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517306 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655601:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181452.655606:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517306 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655614:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517306 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655637:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc373f600) 00010000:00010000:0.0:1789181452.655641:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181452.655647:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655659:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655673:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351730d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655679:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351730d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655684:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351730d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655689:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181452.655692:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351730d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655698:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351730d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655706:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c1dc6843700) 00010000:00010000:0.0:1789181452.655709:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181452.655711:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351730d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655716:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351730d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655779:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ed5 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655802:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc373f600) 00010000:00010000:0.0:1789181452.655805:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181452.655809:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb5552835172ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ed5 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.655820:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1678a00, rc 0) 00000100:00100000:0.0:1789181452.655911:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:11125:x1876092385264512:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 597us (15027us total) trans 0 rc 301/301 00000100:00100000:0.0:1789181452.655919:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:1.0:1789181452.667298:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181452.667461:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385264768 00000100:00100000:0.0:1789181452.667473:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385264768 00000100:00100000:0.0:1789181452.667537:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1789181452.667548:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:11125:x1876092385264768:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:0.0:1789181452.667609:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181452.667650:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835172b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ec0 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.667669:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1cc373f600) 00010000:00010000:0.0:1789181452.667681:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181452.667779:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517314 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.667794:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517314 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.667805:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517314 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.667831:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.667838:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.667844:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668528:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668540:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668547:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181452.668564:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ef0ec50 reply state 0000000005e83ddc transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668575:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668582:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181452.668586:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181452.668589:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789181452.668595:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789181452.668603:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517314 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668610:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517314 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668625:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517314 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668632:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181452.668637:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517314 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668646:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517314 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668656:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc6843000) 00010000:00010000:0.0:1789181452.668659:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181452.668663:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517314 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668669:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517314 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181452.668686:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ef0ec50 reply state 0000000005e83ddc transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668696:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.668702:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c1dc6843c00) 00010000:00010000:0.0:1789181452.668704:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181452.668706:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789181452.668850:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:11125:x1876092385264768:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 1301us (1556us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789181452.668861:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1789181452.779111:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181452.787857:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385264896 00000100:00100000:0.0:1789181452.787894:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385264896 00000100:00100000:0.0:1789181452.787990:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1789181452.788016:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:11133:x1876092385264896:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:0.0:1789181452.788054:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181452.788087:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517329 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7edc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.788164:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb555283517330 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.788178:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb555283517330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.788193:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb555283517330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181452.788244:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789181452.788248:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181452.788291:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb555283517330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.788333:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7edc expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.788352:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb555283517330 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7edc expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.788360:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc6843000) 00010000:00010000:0.0:1789181452.788364:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181452.788380:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1678a00, rc 0) 00000100:00100000:0.0:1789181452.788462:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:11133:x1876092385264896:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 451us (9362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181452.788470:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00010000:00010000:1.0:1789181452.823154:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181452.918681:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181452.918876:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385265024 00000100:00100000:0.0:1789181452.918889:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385265024 00000100:00100000:0.0:1789181452.918945:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:0.0:1789181452.918956:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:11139:x1876092385265024:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1789181452.918990:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181452.919022:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7ee3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.919090:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb55528351733e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.919107:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb55528351733e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.919119:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb55528351733e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.919129:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517345 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.919137:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.919142:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921540:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351734c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921593:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351734c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921608:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351734c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181452.921662:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789181452.921667:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181452.921716:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351734c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921759:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb55528351733e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921766:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb55528351733e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921773:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb55528351733e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921779:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181452.921783:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb55528351733e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921791:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb55528351733e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921807:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc6843000) 00010000:00010000:0.0:1789181452.921810:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181452.921815:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb55528351733e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921831:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb55528351733e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921845:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921851:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921857:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921874:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181452.921877:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921883:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517345 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921892:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c1dc6843c00) 00010000:00010000:0.0:1789181452.921894:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181452.921897:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517345 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921903:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517345 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921940:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ee3 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921956:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351734c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ee3 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181452.921970:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181452.921972:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789181452.921975:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc0030c00, rc 0) 00000100:00100000:0.0:1789181452.922061:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:11139:x1876092385265024:12345-192.168.202.1@tcp:101:bash.0 Request processed in 3105us (3391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181452.922070:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:0.0:1789181452.926003:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181452.926159:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385265280 00000100:00100000:3.0:1789181452.926173:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385265280 00000100:00100000:3.0:1789181452.926234:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1789181452.926245:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:11139:x1876092385265280:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1789181452.926267:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181452.926287:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517353 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7eea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.926414:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351735a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.926431:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351735a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.926459:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351735a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.926495:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.926504:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.926512:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181452.926976:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789181452.927160:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927172:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927181:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927215:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351735a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927223:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351735a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927229:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351735a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927237:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181452.927249:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351735a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927258:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351735a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927271:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:3.0:1789181452.927275:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181452.927281:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351735a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927287:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351735a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181452.927302:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2dad742 reply state 00000000fb5d6e4c transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927313:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927320:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6700) 00010000:00010000:3.0:1789181452.927322:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181452.927325:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789181452.927359:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517353 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eea expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927373:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eea expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.927380:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dfadc6300) 00010000:00010000:3.0:1789181452.927382:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181452.927391:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085ee00, rc 0) 00000100:00100000:3.0:1789181452.927471:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:11139:x1876092385265280:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1227us (1487us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789181452.927480:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:1.0:1789181452.935082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181452.935189:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385265408 00000100:00100000:3.0:1789181452.935202:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385265408 00000100:00100000:3.0:1789181452.935256:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1789181452.935265:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876092385265408:12345-192.168.202.1@tcp:8:bash.0 00010000:00080000:3.0:1789181452.935303:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:3.0:1789181452.935353:0:8435:0:(genops.c:1384:class_connect()) connect: client 3c4ab02e-ed68-4ee0-b458-d9073baffb59, cookie 0x76fb555283517376 00002000:00100000:3.0:1789181452.935366:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3c4ab02e-ed68-4ee0-b458-d9073baffb59/ffff9c1dc78ea000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789181452.935383:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789181452.935460:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789181452.935492:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9c1dc78ee000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181452.935570:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2392:x1876092385265408:12345-192.168.202.1@tcp:8:bash.0 Request processed in 304us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181452.935577:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1789181452.942658:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181452.942815:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385265536 00000100:00100000:1.0:1789181452.942827:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385265536 00000100:00100000:1.0:1789181452.942921:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:1.0:1789181452.942935:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:0:x1876092385265536:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181452.942955:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181452.942981:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b51b5046/0x76fb55528351737d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7ef1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181452.943022:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789181452.943041:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=408s v=(0 0) 00010000:00010000:1.0:1789181452.943047:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181452.943072:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b51b5046/0x76fb55528351737d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef1 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181452.943096:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b51b5046/0x76fb55528351737d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef1 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181452.943110:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12600, rc 0) 00000100:00100000:1.0:1789181452.943437:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:0:x1876092385265536:12345-192.168.202.1@tcp:101:bash.0 Request processed in 246us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181452.943446:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00080000:3.0:1789181452.943517:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181452.948017:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181452.948109:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385265664 00000100:00100000:3.0:1789181452.948122:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385265664 00000100:00100000:3.0:1789181452.948203:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1789181452.948214:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:11139:x1876092385265664:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1789181452.948233:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181452.948256:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7ef8 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.948331:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b51b5046/0x76fb55528351737d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef1 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.948341:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181452.948346:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181452.948351:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.948388:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b51b5046/0x76fb55528351737d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef1 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.948414:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b51b5046/0x76fb55528351737d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef1 expref: 8 pid: 8436 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181452.948429:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1876092408431232:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181452.948540:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789181452.958548:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181452.958796:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1876092408431232:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181452.958838:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181452.958875:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f600, rc 0) 00000100:00100000:3.0:1789181452.958945:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:11139:x1876092385265664:12345-192.168.202.1@tcp:101:bash.0 Request processed in 10732us (10951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181452.958955:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1789181452.959455:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385265792 00000100:00100000:1.0:1789181452.959464:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385265792 00010000:00010000:1.0:1789181452.959505:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b51b5046/0x76fb55528351737d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef1 expref: 8 pid: 8436 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181452.959545:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1789181452.959555:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385265792:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181452.959570:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181452.959592:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b51b5046/0x76fb55528351737d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef1 expref: 8 pid: 8436 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181452.959606:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b51b5046/0x76fb55528351737d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef1 expref: 8 pid: 8436 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181452.959644:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b51b5046/0x76fb55528351737d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef1 expref: 8 pid: 8436 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181452.959668:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181452.959673:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181452.959682:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181452.959692:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181452.959782:0:7462:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181452.959797:0:7462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7462:1876092408431360:192.168.202.1@tcp:105: 00000100:00100000:1.0:1789181452.959878:0:7462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042300 going to sleep for 11 seconds 00000100:00100000:0.0:1789181452.965535:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181452.965654:0:7462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7462:1876092408431360:192.168.202.1@tcp:105: 00010000:00010000:1.0:1789181452.965677:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181452.965762:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385265792:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 6208us (7227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181452.965773:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1789181452.965907:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385266048 00000100:00100000:2.0:1789181452.965916:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385266048 00000100:00100000:2.0:1789181452.965957:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1789181452.965965:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:11139:x1876092385266048:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1789181452.966246:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:11139:x1876092385266048:12345-192.168.202.1@tcp:35:bash.0 Request processed in 281us (720us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789181452.966253:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1789181453.065517:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181453.065640:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385266304 00000100:00100000:1.0:1789181453.065655:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385266304 00000100:00100000:1.0:1789181453.065769:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:1.0:1789181453.065783:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:11149:x1876092385266304:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181453.065815:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181453.066145:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb55528351738b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7eff expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181453.066277:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789181453.066407:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb55528351738b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eff expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.066424:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc6843000) 00010000:00010000:1.0:1789181453.066428:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181453.066433:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb55528351738b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eff expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.066449:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12600, rc 0) 00000100:00100000:1.0:1789181453.066532:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:11149:x1876092385266304:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 752us (1029us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1789181453.066540:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1789181453.069549:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181453.069655:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385266560 00000100:00100000:2.0:1789181453.069667:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385266560 00000100:00100000:2.0:1789181453.069761:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1789181453.069773:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:11149:x1876092385266560:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1789181453.070037:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:11149:x1876092385266560:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 266us (497us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789181453.070045:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1789181453.128844:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181453.128962:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385266688 00000100:00100000:3.0:1789181453.128974:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385266688 00000100:00100000:3.0:1789181453.129054:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1789181453.129065:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:11155:x1876092385266688:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181453.129092:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181453.129119:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.129194:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835173a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.129213:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835173a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.129228:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835173a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181453.129272:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789181453.129276:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181453.129298:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835173a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.129326:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f06 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.129344:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835173a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f06 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.129352:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:3.0:1789181453.129355:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181453.129372:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f000, rc 0) 00000100:00100000:3.0:1789181453.129439:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:11155:x1876092385266688:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 376us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181453.129446:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:0.0:1789181453.134825:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181453.135085:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385266944 00000100:00100000:3.0:1789181453.135096:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385266944 00000100:00100000:3.0:1789181453.135207:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:3.0:1789181453.135219:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:11155:x1876092385266944:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181453.135244:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181453.135268:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f0d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.135396:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835173ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.135412:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835173ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.135425:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835173ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181453.135436:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789181453.135545:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f0d expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.135561:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835173ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f0d expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.135569:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dfadc6300) 00010000:00010000:3.0:1789181453.135585:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181453.135589:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fe00, rc 0) 00000100:00100000:3.0:1789181453.135667:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:11155:x1876092385266944:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 451us (853us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789181453.135674:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1789181453.144261:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181453.144786:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385267200 00000100:00100000:3.0:1789181453.144796:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385267200 00000100:00100000:0.0:1789181453.144930:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181453.145042:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385267328 00000100:00100000:2.0:1789181453.145047:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385267328 00000100:00100000:1.0:1789181453.145468:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1789181453.145484:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11155:x1876092385267200:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181453.145511:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181453.145534:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835173bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f14 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.145682:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.145702:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.145715:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181453.145778:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789181453.145909:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835173bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f14 expref: 25 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.145928:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f14 expref: 24 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.145938:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dfadc6300) 00010000:00010000:1.0:1789181453.145941:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789181453.145945:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13400, rc 0) 00000100:00100000:2.0:1789181453.146306:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:2.0:1789181453.146319:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:2396:x1876092385267328:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181453.146332:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181453.146350:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835173ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f0d expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.146361:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dfadc6300) 00010000:00010000:2.0:1789181453.146364:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181453.146418:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:2396:x1876092385267328:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 104us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.146424:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1789181453.149115:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11155:x1876092385267200:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 3620us (4851us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789181453.149128:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:0.0:1789181453.160031:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181453.160128:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385267456 00000100:00100000:2.0:1789181453.160140:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385267456 00000100:00100000:2.0:1789181453.160211:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1789181453.160222:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385267456:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:2.0:1789181453.160276:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.160302:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.160312:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789181453.160316:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181453.160321:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.160385:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.160401:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 7 pid: 8435 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181453.160416:0:8629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1876092408431488:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181453.160528:0:8629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc38590c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181453.164151:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181453.164245:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385267584 00000100:00100000:3.0:1789181453.164255:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385267584 00002000:00100000:3.0:1789181453.164299:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9c1dd8ba2d80 x1876092385267584/t0(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:584/0 lens 504/0 e 0 to 0 dl 1789181464 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181453.164310:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dd8ba2d80 with x1876092385267584 ext(0->12) 00010000:00010000:3.0:1789181453.164319:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 8 pid: 8435 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.164335:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 8 pid: 8435 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789181453.164343:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c1dd8ba2d80 00000100:00100000:3.0:1789181453.164375:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1789181453.164386:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385267584:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:2.0:1789181453.166149:0:8629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1876092408431488:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181453.166180:0:8629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789181453.166760:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000100:00100000:3.0:1789181453.167684:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2394:x1876092385267584:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 3294us (3536us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789181453.167698:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:3.0:1789181453.167710:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9c1dd8ba2d80 x1876092385267584/t4294967300(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:584/0 lens 504/448 e 0 to 0 dl 1789181464 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181453.167760:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dd8ba2d80 with x1876092385267584 ext(0->12) 00010000:00010000:3.0:1789181453.167770:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 9 pid: 8435 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.167787:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 9 pid: 8435 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789181453.167796:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c1dd8ba2d80 00000100:00100000:0.0:1789181453.175687:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181453.175872:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385267712 00000100:00100000:2.0:1789181453.175882:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385267712 00010000:00010000:2.0:1789181453.175920:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 9 pid: 8435 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181453.175966:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1789181453.175976:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385267712:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181453.175992:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789181453.176010:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789181453.176013:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789181452 00002000:00010000:2.0:1789181453.176016:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789181452 00002000:00010000:2.0:1789181453.176018:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789181452 00002000:00010000:2.0:1789181453.176027:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789181453.176034:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 9 pid: 8435 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.176049:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 9 pid: 8435 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.176078:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f6a9465/0x76fb555283517384 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ef8 expref: 9 pid: 8435 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.176097:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181453.176101:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181453.176107:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.176117:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.176152:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181453.176221:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385267712:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 245us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.176229:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00010000:00010000:0.0:1789181453.176627:0:8629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.176640:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.176663:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.176680:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.176688:0:8629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.176696:0:8629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084ae00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181453.176701:0:8629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.176710:0:8629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.176758:0:8629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.176767:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835173d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181453.176823:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385267456:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 16603us (16803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.176830:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1789181453.184180:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181453.184754:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385267968 00000100:00100000:3.0:1789181453.184765:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385267968 00000100:00100000:3.0:1789181453.184818:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1789181453.184841:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11155:x1876092385267968:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:3.0:1789181453.184916:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f14 expref: 22 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181453.185173:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789181453.185225:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789181453.185571:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1789181453.185608:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.185639:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eea expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.185648:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.185689:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eea expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.185713:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eea expref: 26 pid: 6521 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181453.185756:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876092408431616:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181453.185852:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789181453.188950:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181453.189067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385268096 00000100:00100000:0.0:1789181453.189078:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385268096 00010000:00010000:0.0:1789181453.189134:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eea expref: 27 pid: 6521 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181453.189186:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1789181453.189197:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:2394:x1876092385268096:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181453.189217:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181453.189225:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eea expref: 27 pid: 6521 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.189240:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eea expref: 27 pid: 6521 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.189263:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dfadc6300) 00010000:00010000:0.0:1789181453.189268:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.189278:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.189287:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.189308:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181453.189370:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:2394:x1876092385268096:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 174us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.189377:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00010000:00010000:3.0:1789181453.190011:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517368 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eea expref: 26 pid: 6521 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181453.190030:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876092408431616:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181453.190051:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.190061:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.190067:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181453.190401:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1789181453.190514:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1789181453.190601:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408431744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789181453.190840:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181453.190881:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181453.191026:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408431744 00000100:00100000:0.0:1789181453.191033:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408431744 00000100:00100000:0.0:1789181453.191105:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789181453.191127:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1876092408431744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789181453.191210:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1876092408431744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.191217:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1789181453.194049:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181453.194122:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408431744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789181453.194327:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1789181453.194409:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408431872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789181453.194463:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181453.194492:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181453.194633:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408431872 00000100:00100000:0.0:1789181453.194640:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408431872 00000100:00100000:0.0:1789181453.194688:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789181453.194698:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1876092408431872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789181453.194876:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1876092408431872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 179us (411us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789181453.194884:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789181453.194976:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408431872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789181453.195025:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1789181453.195060:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.195071:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.195079:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.195085:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181453.195090:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.195106:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.195123:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dfadc6300) 00010000:00010000:1.0:1789181453.195126:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789181453.195132:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.195139:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835173d8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789181453.195231:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789181453.195314:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789181453.195326:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409182601753ns, next at 410182599321ns, rc = 0 00000001:00080000:1.0:1789181453.195332:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1789181453.195351:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dfadc6300) 00010000:00010000:1.0:1789181453.195354:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789181453.195361:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f14 expref: 30 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181453.195450:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:11155:x1876092385267968:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 10623us (11283us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789181453.195458:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000020:00080000:1.0:1789181453.195462:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789181453.199257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181453.199349:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385268224 00000100:00100000:1.0:1789181453.199360:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385268224 00000100:00100000:1.0:1789181453.199416:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1789181453.199426:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:11155:x1876092385268224:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181453.199470:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181453.199493:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835173df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f1b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.199553:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835173df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f1b expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.199567:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835173df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f1b expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.199584:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:1.0:1789181453.199586:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181453.199590:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12600, rc 0) 00000100:00100000:1.0:1789181453.199670:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:11155:x1876092385268224:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 245us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181453.199678:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1789181453.203504:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181453.208010:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385268480 00000100:00100000:1.0:1789181453.208031:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385268480 00000100:00100000:1.0:1789181453.208139:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1789181453.208151:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd9359c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:11155:x1876092385268480:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1789181453.208394:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd9359c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+31:11155:x1876092385268480:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 245us (4898us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789181453.208403:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1789181453.283762:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181453.283917:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385268736 00000100:00100000:2.0:1789181453.283930:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385268736 00000100:00100000:2.0:1789181453.283988:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1789181453.284000:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+31:11165:x1876092385268736:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181453.284052:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181453.284078:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb5552835173e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f22 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181453.284192:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789181453.284290:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb5552835173e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f22 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.284306:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc6843000) 00010000:00010000:2.0:1789181453.284309:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181453.284315:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb5552835173e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f22 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.284330:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b400, rc 0) 00000100:00100000:2.0:1789181453.284396:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:11165:x1876092385268736:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 398us (679us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789181453.284403:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1789181453.286370:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181453.286500:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385268864 00000100:00100000:1.0:1789181453.286511:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385268864 00000100:00100000:1.0:1789181453.286566:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1789181453.286576:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:11165:x1876092385268864:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1789181453.286667:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.286685:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.286696:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.286708:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835173fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.286716:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835173fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.286762:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835173fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287103:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287114:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287122:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181453.287171:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287185:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287202:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287209:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287215:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181453.287220:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287228:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287252:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:1.0:1789181453.287255:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181453.287260:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287267:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835173f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287282:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835173fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287288:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835173fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287293:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835173fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287298:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181453.287307:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835173fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287314:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835173fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287322:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6700) 00010000:00010000:1.0:1789181453.287325:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181453.287328:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835173fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287334:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835173fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287344:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287350:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287356:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287361:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181453.287364:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287370:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287377:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:1.0:1789181453.287379:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181453.287388:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.287394:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517402 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181453.287506:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:11165:x1876092385268864:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 930us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181453.287514:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1789181453.292452:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181453.292532:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385269120 00000100:00100000:3.0:1789181453.292543:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385269120 00000100:00100000:3.0:1789181453.292601:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1789181453.292612:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:11165:x1876092385269120:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1789181453.293150:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+33:11165:x1876092385269120:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 538us (706us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789181453.293160:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1789181453.329020:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181453.329214:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385269376 00000100:00100000:2.0:1789181453.329225:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385269376 00000100:00100000:2.0:1789181453.329337:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1789181453.329349:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+33:11168:x1876092385269376:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181453.329376:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181453.329398:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517409 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f29 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329481:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517410 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329516:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517410 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329528:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517410 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329541:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517417 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329550:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517417 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329557:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517417 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329682:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329693:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329700:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181453.329711:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789181453.329874:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517410 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329882:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517410 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329889:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517410 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329902:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084be00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181453.329907:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517410 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329916:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517410 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329930:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:2.0:1789181453.329934:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181453.329939:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517410 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329946:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517410 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329960:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517417 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329966:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517417 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329972:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517417 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.329977:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181453.330206:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517417 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.330216:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517417 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.330236:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6700) 00010000:00010000:2.0:1789181453.330239:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181453.330242:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517417 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.330248:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517417 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.330291:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517409 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f29 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.330308:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f29 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.330315:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:2.0:1789181453.330318:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181453.330320:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084bc00, rc 0) 00000100:00100000:2.0:1789181453.330385:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:11168:x1876092385269376:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1038us (1376us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789181453.330393:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1789181453.340569:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181453.340692:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385269504 00000100:00100000:3.0:1789181453.340703:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385269504 00000100:00100000:3.0:1789181453.340797:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1789181453.340807:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:11168:x1876092385269504:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1789181453.340909:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351742c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.340928:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351742c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.340941:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351742c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.340979:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351742c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.340986:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351742c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.340993:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351742c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.341025:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ee00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181453.341031:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351742c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.341039:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351742c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.341052:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181453.341055:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181453.341060:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351742c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.341066:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351742c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181453.341134:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:11168:x1876092385269504:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 328us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181453.341142:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:0.0:1789181453.353200:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181453.353354:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385269760 00000100:00100000:1.0:1789181453.353365:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385269760 00000100:00100000:1.0:1789181453.353425:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1789181453.353438:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:11168:x1876092385269760:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1789181453.353696:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+36:11168:x1876092385269760:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 260us (505us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789181453.353705:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1789181453.580310:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181453.580333:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408432000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181453.580405:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181453.580519:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408432000 00000100:00100000:1.0:1789181453.580528:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408432000 00000100:00100000:1.0:1789181453.580592:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789181453.580601:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408432000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789181453.580627:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181453.580673:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408432000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181453.580680:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1789181453.580817:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181453.580832:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408432128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181453.580896:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181453.581805:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408432000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181453.587663:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408432128 00000100:00100000:0.0:1789181453.587683:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408432128 00000100:00100000:0.0:1789181453.587848:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789181453.587875:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408432128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181453.587911:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181453.588042:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408432128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (7145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.588050:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789181453.588157:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408432128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181453.625036:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181453.625324:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385270016 00000100:00100000:1.0:1789181453.625336:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385270016 00000100:00100000:1.0:1789181453.625409:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:1.0:1789181453.625421:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+36:11199:x1876092385270016:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:1.0:1789181453.625467:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181453.625489:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517433 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f30 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.625613:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351743a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.625631:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351743a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.625644:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351743a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181453.625655:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789181453.625842:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517433 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f30 expref: 39 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.625873:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351743a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f30 expref: 38 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.625884:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:1.0:1789181453.625887:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181453.625891:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13c00, rc 0) 00000100:00100000:1.0:1789181453.625952:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:11199:x1876092385270016:12345-192.168.202.1@tcp:101:cat.0 Request processed in 533us (927us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789181453.625960:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1789181453.639712:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181453.639793:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181453.639885:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385270400 00000100:00100000:2.0:1789181453.639897:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385270400 00000100:00100000:2.0:1789181453.639990:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1789181453.640002:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:2395:x1876092385270400:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181453.640019:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181453.640046:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351743a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f30 expref: 38 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.640090:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:2.0:1789181453.640095:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181453.640158:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:2395:x1876092385270400:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 159us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.640166:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1789181453.640450:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385270272 00000100:00100000:1.0:1789181453.640455:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385270272 00000100:00100000:1.0:1789181453.640493:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1789181453.640508:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:11199:x1876092385270272:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1789181453.640697:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:11199:x1876092385270272:12345-192.168.202.1@tcp:35:cat.0 Request processed in 190us (996us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789181453.640704:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1789181453.677932:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181453.677977:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181453.678016:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181453.678054:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181453.678081:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181453.678116:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385271040 00000100:00100000:0.0:1789181453.678127:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385271040 00000100:00100000:0.0:1789181453.678190:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385270656 00000100:00100000:0.0:1789181453.678194:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385270656 00000100:00100000:0.0:1789181453.678208:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385270912 00000100:00100000:0.0:1789181453.678211:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385270912 00000100:00100000:0.0:1789181453.678231:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 293 00000100:00100000:0.0:1789181453.678242:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385271040:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181453.678334:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385271040:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 92us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.678342:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 293 00000100:00100000:0.0:1789181453.678363:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 294 00000100:00100000:0.0:1789181453.678369:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385270656:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181453.678424:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385270656:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 54us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.678431:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 294 00000100:00100000:0.0:1789181453.678445:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 295 00000100:00100000:0.0:1789181453.678452:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385270912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181453.678478:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385270912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.678491:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 295 00000100:00080000:3.0:1789181453.678707:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181453.678718:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789181453.678889:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385270784 00000100:00100000:1.0:1789181453.678895:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385270784 00000100:00100000:1.0:1789181453.678939:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:1.0:1789181453.678947:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385270784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181453.678982:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385270784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181453.678988:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:2.0:1789181453.679177:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385270528 00000100:00100000:2.0:1789181453.679183:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385270528 00000100:00100000:2.0:1789181453.679226:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 382 00000100:00100000:2.0:1789181453.679234:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385270528:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181453.679261:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385270528:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.679267:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 382 00000100:00100000:0.0:1789181453.695008:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181453.695123:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385271296 00000100:00100000:1.0:1789181453.695135:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385271296 00000100:00100000:1.0:1789181453.695197:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1789181453.695207:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:11206:x1876092385271296:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1789181453.695232:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181453.695236:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789181453.695264:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835173a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f06 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.695282:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:1.0:1789181453.695287:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181453.695299:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517448 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f37 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.695411:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.695442:0:9021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f29 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.695451:0:9021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.695809:0:9021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f29 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.695826:0:9021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f29 expref: 38 pid: 6521 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181453.695841:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408432256:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181453.695964:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042900 going to sleep for 11 seconds 00000100:00100000:0.0:1789181453.698870:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181453.699118:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385271424 00000100:00100000:2.0:1789181453.699128:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385271424 00010000:00010000:2.0:1789181453.699171:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f29 expref: 39 pid: 6521 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181453.699216:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1789181453.699226:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+39:2393:x1876092385271424:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181453.699243:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181453.699251:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f29 expref: 39 pid: 6521 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.699264:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f29 expref: 39 pid: 6521 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.699311:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:2.0:1789181453.699317:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.699329:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.699337:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.699361:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181453.699434:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+39:2393:x1876092385271424:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 209us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.699442:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00010000:00010000:1.0:1789181453.700979:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351741e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f29 expref: 38 pid: 6521 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181453.701019:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f67100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408432256:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181453.701057:0:9021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.701068:0:9021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.701073:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181453.701097:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789181453.701278:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517448 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f37 expref: 39 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.701294:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f37 expref: 38 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.701303:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:1.0:1789181453.701305:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789181453.701308:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13400, rc 0) 00000100:00100000:1.0:1789181453.701362:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:11206:x1876092385271296:12345-192.168.202.1@tcp:101:dd.0 Request processed in 6157us (6366us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789181453.701370:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:0.0:1789181453.704066:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181453.704149:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385271552 00000100:00100000:3.0:1789181453.704158:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385271552 00000100:00100000:3.0:1789181453.704212:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1789181453.704221:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:11206:x1876092385271552:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1789181453.704244:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181453.704264:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351745d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f3e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.704296:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.704312:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.704324:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.704453:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb55528351745d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f3e expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.704471:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f3e expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.704480:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181453.704482:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789181453.704485:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e000, rc 0) 00000100:00100000:3.0:1789181453.704546:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+39:11206:x1876092385271552:12345-192.168.202.1@tcp:101:dd.0 Request processed in 327us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181453.704552:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:0.0:1789181453.708643:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181453.708997:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385271808 00000100:00100000:3.0:1789181453.709011:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385271808 00000100:00100000:3.0:1789181453.709218:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:3.0:1789181453.709230:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+39:11206:x1876092385271808:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:3.0:1789181453.709499:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.709520:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.709532:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181453.709578:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789181453.709598:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7f2a8ad reply state 00000000342930f8 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.709610:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.709631:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181453.709634:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181453.709638:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181453.709762:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+42:11206:x1876092385271808:12345-192.168.202.1@tcp:36:dd.0 Request processed in 534us (1130us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789181453.709770:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000020:00080000:3.0:1789181453.709775:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789181453.837328:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181453.838019:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789181453.900823:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789181454.028643:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181454.028749:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385271936 00000100:00100000:3.0:1789181454.028760:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385271936 00000100:00100000:3.0:1789181454.028835:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:3.0:1789181454.028860:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+42:11220:x1876092385271936:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:3.0:1789181454.028894:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181454.028915:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517472 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f45 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.028984:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517479 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.029000:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517479 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.029013:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517479 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.029287:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517480 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.029297:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.029305:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.029595:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.029609:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f37 expref: 43 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.029618:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.029685:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f37 expref: 43 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.029702:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f37 expref: 43 pid: 9021 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181454.029716:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408432384:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181454.030066:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1480 going to sleep for 11 seconds 00000100:00080000:0.0:1789181454.030169:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181454.035329:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181454.035448:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408432384:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181454.035477:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181454.035602:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385272192 00000100:00100000:1.0:1789181454.035611:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385272192 00000100:00100000:1.0:1789181454.035671:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1789181454.035683:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+44:6167:x1876092385272192:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789181454.036056:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+45:6167:x1876092385272192:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 374us (736us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789181454.036064:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1789181454.040471:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181454.041568:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385272320 00000100:00100000:3.0:1789181454.041581:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385272320 00010000:00010000:3.0:1789181454.041900:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f37 expref: 45 pid: 9021 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181454.041949:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1789181454.041960:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+45:2393:x1876092385272320:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181454.042116:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181454.042126:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f37 expref: 45 pid: 9021 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.042139:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f37 expref: 45 pid: 9021 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.042183:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb55528351744f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f37 expref: 45 pid: 9021 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.042200:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181454.042205:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.042215:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.042222:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.042704:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181454.042828:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+44:2393:x1876092385272320:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 868us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181454.042837:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00010000:00010000:2.0:1789181454.048352:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.048373:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181454.048448:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789181454.048453:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181454.048507:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.048524:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.048534:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517479 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.048554:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517479 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.048560:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517479 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.048566:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ec00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181454.048571:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517479 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.048578:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517479 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.048594:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:2.0:1789181454.048596:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181454.048601:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517479 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.048608:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517479 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.049002:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.049008:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517480 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.049013:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.049018:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ea00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181454.049039:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.049048:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.049057:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6700) 00010000:00010000:2.0:1789181454.049060:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181454.049063:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517480 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.049070:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517480 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.049114:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517472 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f45 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.049128:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f45 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.049135:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:2.0:1789181454.049138:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181454.049140:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fc00, rc 0) 00000100:00100000:2.0:1789181454.049269:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:11220:x1876092385271936:12345-192.168.202.1@tcp:101:stat.0 Request processed in 20416us (20634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181454.049278:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1789181454.193876:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181454.194945:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385272576 00000100:00100000:0.0:1789181454.194959:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385272576 00000100:00100000:0.0:1789181454.195047:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1789181454.195059:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:11226:x1876092385272576:12345-192.168.202.1@tcp:36:truncate.0 00010000:00010000:0.0:1789181454.195131:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181454.195161:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb555283517487 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f45 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.195182:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:0.0:1789181454.195188:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181454.195393:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.195422:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.195434:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181454.195479:0:9021:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1789181454.195520:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000769724ee reply state 000000006de55b14 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.195534:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.195541:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:0.0:1789181454.195544:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181454.195547:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181454.195687:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+45:11226:x1876092385272576:12345-192.168.202.1@tcp:36:truncate.0 Request processed in 630us (1821us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789181454.195695:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000020:00080000:0.0:1789181454.195700:0:9021:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789181454.478623:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181454.478815:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385272704 00000100:00100000:1.0:1789181454.478827:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385272704 00000100:00100000:1.0:1789181454.478903:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:1.0:1789181454.478914:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+45:11240:x1876092385272704:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:1.0:1789181454.478940:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181454.478983:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517495 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f4c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479074:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb55528351749c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479092:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb55528351749c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479103:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb55528351749c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479115:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835174a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479122:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835174a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479140:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835174a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479219:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479228:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479235:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181454.479276:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789181454.479281:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181454.479303:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479324:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479333:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb55528351749c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479339:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb55528351749c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479347:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb55528351749c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479352:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181454.479358:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb55528351749c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479365:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb55528351749c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479378:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:1.0:1789181454.479380:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181454.479385:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb55528351749c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479390:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb55528351749c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479403:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835174a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479409:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835174a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479421:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835174a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479426:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181454.479430:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835174a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479436:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835174a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479444:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6700) 00010000:00010000:1.0:1789181454.479447:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181454.479449:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835174a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479454:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb5552835174a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479481:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517495 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f4c expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479494:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f4c expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.479502:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:1.0:1789181454.479504:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181454.479506:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13a00, rc 0) 00000100:00100000:1.0:1789181454.480244:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+46:11240:x1876092385272704:12345-192.168.202.1@tcp:101:stat.0 Request processed in 1327us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181454.480265:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1789181454.604117:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408432512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181454.604214:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181454.604432:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408432512 00000100:00100000:3.0:1789181454.604440:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408432512 00000100:00100000:3.0:1789181454.604490:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789181454.604500:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408432512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181454.604546:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1789181454.604604:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408432512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181454.604610:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789181454.604927:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408432512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181454.616122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181454.616209:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385272960 00000100:00100000:0.0:1789181454.616221:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385272960 00000100:00100000:0.0:1789181454.616296:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:0.0:1789181454.616309:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+46:11250:x1876092385272960:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181454.616345:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181454.616368:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835174b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f53 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181454.616478:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789181454.616591:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835174b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f53 expref: 48 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.616607:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc6843000) 00010000:00010000:0.0:1789181454.616610:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181454.616616:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835174b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f53 expref: 48 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.616650:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc0031600, rc 0) 00000100:00100000:0.0:1789181454.616714:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+47:11250:x1876092385272960:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 407us (602us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1789181454.616765:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:1.0:1789181454.629670:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181454.629883:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385273216 00000100:00100000:3.0:1789181454.629964:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385273216 00000100:00100000:3.0:1789181454.630199:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1789181454.630211:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+47:11250:x1876092385273216:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1789181454.630874:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+48:11250:x1876092385273216:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 662us (1277us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789181454.630883:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1789181454.700187:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181454.700906:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385273472 00000100:00100000:2.0:1789181454.700918:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385273472 00000100:00100000:2.0:1789181454.700992:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:2.0:1789181454.701004:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+48:11256:x1876092385273472:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1789181454.701039:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181454.701061:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835174bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f5a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.701167:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.701182:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f4c expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.701192:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.701227:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f4c expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.701241:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f4c expref: 49 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181454.701255:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408432640:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181454.701372:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3859300 going to sleep for 11 seconds 00000100:00100000:2.0:1789181454.708146:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181454.708233:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385273600 00000100:00100000:0.0:1789181454.708243:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385273600 00010000:00010000:0.0:1789181454.708284:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f4c expref: 50 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181454.708331:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1789181454.708340:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+50:2394:x1876092385273600:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181454.708576:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181454.708586:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f4c expref: 50 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.708601:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f4c expref: 50 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.708633:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:0.0:1789181454.708639:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.708649:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.708658:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.708692:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181454.708788:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+50:2394:x1876092385273600:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 448us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181454.708796:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00010000:00010000:3.0:1789181454.710675:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb5552835174aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f4c expref: 49 pid: 6523 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181454.710700:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408432640:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181454.710765:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.710777:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.710783:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181454.710805:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789181454.710965:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835174bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f5a expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.710982:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f5a expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.710991:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181454.710994:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789181454.711010:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084be00, rc 0) 00000100:00100000:3.0:1789181454.711068:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+49:11256:x1876092385273472:12345-192.168.202.1@tcp:101:bash.0 Request processed in 10067us (10891us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789181454.711077:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:2.0:1789181454.715672:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181454.715902:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385273856 00000100:00100000:3.0:1789181454.715914:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385273856 00000100:00100000:3.0:1789181454.715963:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:3.0:1789181454.715984:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+49:11256:x1876092385273856:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:3.0:1789181454.716224:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.716242:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.716254:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181454.716296:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1789181454.716316:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001aa7c25a reply state 00000000cb1f177b transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.716329:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.716336:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181454.716339:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181454.716343:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181454.716438:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+52:11256:x1876092385273856:12345-192.168.202.1@tcp:36:bash.0 Request processed in 454us (780us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789181454.716571:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000020:00080000:3.0:1789181454.716592:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789181454.725296:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181454.725682:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385273984 00000100:00100000:1.0:1789181454.725694:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385273984 00000100:00100000:1.0:1789181454.725788:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:1.0:1789181454.725798:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+52:11256:x1876092385273984:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181454.725823:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181454.725920:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835174db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f61 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.726142:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.726158:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f5a expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.726166:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.726200:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f5a expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181454.726215:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f5a expref: 53 pid: 6521 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181454.726230:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408432768:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181454.726854:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181454.731054:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181454.731930:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385274112 00000100:00100000:3.0:1789181454.731943:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385274112 00010000:00010000:3.0:1789181454.731999:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f5a expref: 54 pid: 6521 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181454.732043:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1789181454.732054:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:2393:x1876092385274112:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181454.732069:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181454.732075:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f5a expref: 54 pid: 6521 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.732088:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f5a expref: 54 pid: 6521 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.732110:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181454.732116:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.732125:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.732133:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.732154:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181454.732222:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:2393:x1876092385274112:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 169us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181454.732230:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00010000:00010000:2.0:1789181454.734234:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f5a expref: 53 pid: 6521 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181454.734272:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408432768:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181454.734297:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.734308:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.734315:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181454.734387:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789181454.734392:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181454.734412:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.734674:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835174db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f61 expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.734691:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f61 expref: 52 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.734699:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:2.0:1789181454.734702:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181454.734705:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13400, rc 0) 00000100:00100000:2.0:1789181454.734990:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+52:11256:x1876092385273984:12345-192.168.202.1@tcp:101:bash.0 Request processed in 9193us (9703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181454.734998:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:1.0:1789181454.740929:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181454.741061:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385274368 00000100:00100000:3.0:1789181454.741072:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385274368 00000100:00100000:3.0:1789181454.741175:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1789181454.741187:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd935b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+52:11256:x1876092385274368:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:3.0:1789181454.741425:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd935b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+53:11256:x1876092385274368:12345-192.168.202.1@tcp:35:bash.0 Request processed in 239us (505us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789181454.741438:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1789181454.851715:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181454.851928:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385274624 00000100:00100000:3.0:1789181454.851941:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385274624 00000100:00100000:2.0:1789181454.852200:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1789181454.852212:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+53:11266:x1876092385274624:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181454.852239:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181454.852263:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f68 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181454.852457:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789181454.852654:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f68 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.852669:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc6843000) 00010000:00010000:2.0:1789181454.852672:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181454.852677:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb5552835174e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f68 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.852691:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084be00, rc 0) 00000100:00100000:2.0:1789181454.852860:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:11266:x1876092385274624:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 649us (1154us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1789181454.852869:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1789181454.857102:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181454.857211:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385274752 00000100:00100000:3.0:1789181454.857223:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385274752 00000100:00100000:3.0:1789181454.857321:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:3.0:1789181454.857333:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:11266:x1876092385274752:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1789181454.857429:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835174f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.857448:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835174f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.857459:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835174f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.857489:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835174fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.857496:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835174fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.857502:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835174fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.857594:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.857866:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.857877:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181454.857939:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.857954:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835174f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.857961:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835174f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858096:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835174f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858105:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ee00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181454.858110:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835174f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858118:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835174f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858132:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:3.0:1789181454.858136:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181454.858140:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835174f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858156:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835174f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858171:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835174fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858177:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835174fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858183:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835174fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858188:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ea00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181454.858191:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835174fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858196:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835174fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858204:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6700) 00010000:00010000:3.0:1789181454.858206:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181454.858209:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835174fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858215:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835174fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858225:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858231:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858243:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858248:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ec00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181454.858251:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858258:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858266:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181454.858268:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181454.858271:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181454.858276:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517505 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181454.858423:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:11266:x1876092385274752:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1090us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181454.858432:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00010000:00010000:0.0:1789181454.861812:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181454.862150:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181454.862240:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385275008 00000100:00100000:0.0:1789181454.862249:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385275008 00000100:00100000:0.0:1789181454.862306:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1789181454.862316:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:11266:x1876092385275008:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1789181454.863084:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+55:11266:x1876092385275008:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 767us (936us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789181454.863095:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1789181454.900073:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181454.900193:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385275264 00000100:00100000:0.0:1789181454.900205:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385275264 00000100:00100000:0.0:1789181454.900275:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:0.0:1789181454.900288:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+55:11269:x1876092385275264:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181454.900320:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181454.900357:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb55528351750c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f6f expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900445:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517513 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900477:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517513 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900508:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517513 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900522:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351751a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900530:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351751a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900536:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351751a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900675:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517521 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900685:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900692:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181454.900702:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789181454.900835:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517513 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900856:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517513 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900863:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517513 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900869:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181454.900881:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517513 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900889:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517513 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900902:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181454.900905:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181454.900910:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517513 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900917:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517513 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900934:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351751a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900941:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351751a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900947:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351751a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900952:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181454.900955:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351751a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900961:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351751a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900968:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6700) 00010000:00010000:0.0:1789181454.900971:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181454.900980:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351751a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.900986:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351751a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.901030:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb55528351750c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f6f expref: 58 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.901048:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517521 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f6f expref: 57 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.901055:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:0.0:1789181454.901057:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181454.901059:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679000, rc 0) 00000100:00100000:0.0:1789181454.901126:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:11269:x1876092385275264:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 840us (1068us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789181454.901134:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1789181454.908852:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181454.908900:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181454.909006:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385275392 00000100:00100000:2.0:1789181454.909017:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385275392 00000100:00100000:2.0:1789181454.909076:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:2.0:1789181454.909086:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:11269:x1876092385275392:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:2.0:1789181454.909160:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb55528351752f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.909178:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb55528351752f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.909206:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb55528351752f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.909244:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb55528351752f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.909251:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb55528351752f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.909258:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb55528351752f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.909265:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084be00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181454.909270:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb55528351752f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.909278:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb55528351752f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.909291:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:2.0:1789181454.909294:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181454.909299:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb55528351752f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181454.909305:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb55528351752f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181454.909390:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:11269:x1876092385275392:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 305us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181454.909398:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:0.0:1789181454.909508:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385275520 00000100:00100000:0.0:1789181454.909513:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385275520 00000100:00100000:0.0:1789181454.909560:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1789181454.909567:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:2394:x1876092385275520:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181454.909578:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181454.909594:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517521 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f6f expref: 57 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181454.909605:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:0.0:1789181454.909608:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181454.909636:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+56:2394:x1876092385275520:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 70us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181454.909643:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1789181454.912410:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181454.912601:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385275776 00000100:00100000:3.0:1789181454.912621:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385275776 00000100:00100000:3.0:1789181454.912686:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1789181454.912697:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+56:11269:x1876092385275776:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1789181454.912994:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:11269:x1876092385275776:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 297us (593us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789181454.913001:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1789181455.090272:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181455.090491:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385276032 00000100:00100000:0.0:1789181455.090502:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385276032 00000100:00100000:0.0:1789181455.090576:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:0.0:1789181455.090588:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:11287:x1876092385276032:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:0.0:1789181455.090616:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181455.090638:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517536 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f76 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.090775:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351753d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.090788:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351753d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.090798:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351753d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181455.090807:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789181455.090952:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517536 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f76 expref: 60 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.091096:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351753d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f76 expref: 59 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.091103:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:0.0:1789181455.091106:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789181455.091127:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679600, rc 0) 00000100:00100000:0.0:1789181455.091223:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:11287:x1876092385276032:12345-192.168.202.1@tcp:101:cat.0 Request processed in 638us (961us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1789181455.091229:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1789181455.115983:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181455.116010:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408432896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181455.116084:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181455.116627:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408432896 00000100:00100000:0.0:1789181455.116636:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408432896 00000100:00100000:0.0:1789181455.116701:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789181455.116711:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408432896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181455.116762:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181455.116815:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408432896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181455.116821:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1789181455.116904:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181455.116948:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408432896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181455.117786:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408433024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181455.117824:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181455.117885:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408433024 00000100:00100000:3.0:1789181455.117902:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408433024 00000100:00100000:3.0:1789181455.117937:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789181455.117942:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408433024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181455.117954:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181455.117985:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408433024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181455.117993:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789181455.118026:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408433024:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789181455.118038:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181455.119137:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408433408:0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119175:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181455.119196:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408433920:0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119214:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181455.119228:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408434432:0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119238:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181455.119251:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789181455.119254:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408433280:0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119265:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181455.119283:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408433792:0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119294:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181455.119306:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408434304:0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119341:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181455.119360:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408433920 00000100:00100000:1.0:1789181455.119364:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408433920 00000100:00100000:1.0:1789181455.119397:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408434432 00000100:00100000:1.0:1789181455.119398:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408434432 00000100:00100000:1.0:1789181455.119407:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408433280 00000100:00100000:1.0:1789181455.119408:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408433280 00000100:00100000:1.0:1789181455.119414:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408433792 00000100:00100000:1.0:1789181455.119415:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408433792 00000100:00100000:1.0:1789181455.119422:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408434304 00000100:00100000:1.0:1789181455.119423:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408434304 00000100:00100000:1.0:1789181455.119431:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789181455.119436:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408433920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119474:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408433920:12345-0@lo:400:kworker.0 Request processed in 37us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.119481:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789181455.119494:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789181455.119499:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408434432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119526:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408434432:12345-0@lo:400:kworker.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.119531:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789181455.119541:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789181455.119546:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408433280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119567:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408433280:12345-0@lo:400:kworker.0 Request processed in 21us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.119571:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789181455.119579:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789181455.119584:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408433792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119604:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408433792:12345-0@lo:400:kworker.0 Request processed in 20us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.119619:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789181455.119630:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789181455.119635:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408434304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119660:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408434304:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.119664:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789181455.119690:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408433280:0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119699:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408433792:0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.119705:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408434304:0@lo:400:kworker.0 00010000:00080000:1.0:1789181455.119715:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd92aaa00 x1876092408433920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181455.119747:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408433920:0@lo:400:kworker.0 00010000:00080000:1.0:1789181455.119756:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd92a8700 x1876092408434432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181455.119764:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408434432:0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120139:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408433152:0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120169:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181455.120196:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408433664:0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120211:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181455.120225:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408434176:0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120239:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181455.120252:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789181455.120255:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408433536:0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120266:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181455.120275:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408434048:0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120285:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181455.120304:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408433408 00000100:00100000:0.0:1789181455.120308:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408433408 00000100:00100000:0.0:1789181455.120339:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408433664 00000100:00100000:0.0:1789181455.120347:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408433664 00000100:00100000:0.0:1789181455.120360:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789181455.120363:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408433408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120393:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408433408:12345-0@lo:400:kworker.0 Request processed in 29us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181455.120397:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789181455.120407:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789181455.120411:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408433664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120427:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408433664:12345-0@lo:400:kworker.0 Request processed in 16us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181455.120431:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789181455.120441:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408434176 00000100:00100000:0.0:1789181455.120443:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408434176 00000100:00100000:0.0:1789181455.120461:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408434048 00000100:00100000:0.0:1789181455.120463:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408434048 00000100:00100000:0.0:1789181455.120480:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789181455.120486:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408434176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120514:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408434176:12345-0@lo:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181455.120520:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789181455.120531:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789181455.120536:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408434048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120560:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408434048:12345-0@lo:400:kworker.0 Request processed in 24us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181455.120563:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789181455.120587:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408434048:0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120602:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408433664:0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120611:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408434176:0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120644:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408433408:0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120664:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408433536 00000100:00100000:0.0:1789181455.120667:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408433536 00000100:00100000:0.0:1789181455.120685:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789181455.120689:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408433536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181455.120712:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408433536:12345-0@lo:400:kworker.0 Request processed in 23us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181455.120716:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789181455.120759:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408433536:0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.121018:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408433152 00000100:00100000:1.0:1789181455.121022:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408433152 00000100:00100000:1.0:1789181455.121062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789181455.121073:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc6dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408433152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181455.121179:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc6dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408433152:12345-0@lo:400:kworker.0 Request processed in 110us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.121185:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789181455.121229:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408433152:0@lo:400:kworker.0 00000100:00080000:3.0:1789181455.121639:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181455.121647:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181455.121650:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181455.126402:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181455.126578:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385276160 00000100:00100000:1.0:1789181455.126589:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385276160 00000100:00100000:1.0:1789181455.126660:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1789181455.126671:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:11288:x1876092385276160:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181455.126698:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181455.126720:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb55528351754b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f7d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.129640:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517552 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.129657:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.129669:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181455.129715:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789181455.129719:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181455.129757:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.129787:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb55528351754b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f7d expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.129809:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f7d expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.129817:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:1.0:1789181455.129834:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181455.129838:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13c00, rc 0) 00000100:00100000:1.0:1789181455.130216:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:11288:x1876092385276160:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 3543us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.130226:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1789181455.138052:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181455.138153:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385276544 00000100:00100000:3.0:1789181455.138165:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385276544 00000100:00100000:3.0:1789181455.138236:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1789181455.138248:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:11288:x1876092385276544:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:3.0:1789181455.138615:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11288:x1876092385276544:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 368us (573us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789181455.138642:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1789181455.142052:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181455.142149:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385276672 00000100:00100000:3.0:1789181455.142160:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385276672 00000100:00100000:3.0:1789181455.142285:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1789181455.142296:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11288:x1876092385276672:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:3.0:1789181455.142313:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789181455.142340:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835174e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f61 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.142362:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351753d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f76 expref: 60 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.142375:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835173df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f1b expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.142384:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181455.142389:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181455.142451:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:11288:x1876092385276672:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 157us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181455.143096:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1789181455.145410:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181455.145578:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385276800 00000100:00100000:0.0:1789181455.145590:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385276800 00000100:00100000:0.0:1789181455.145789:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1789181455.145801:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:11288:x1876092385276800:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:0.0:1789181455.146079:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517559 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.146100:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517559 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.146112:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517559 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789181455.146362:0:9021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181455.146580:0:9021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789181455.146777:0:9021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789181455.147017:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:11288:x1876092385276800:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 1216us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181455.147027:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:0.0:1789181455.170508:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181455.170702:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385276928 00000100:00100000:1.0:1789181455.170713:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385276928 00000100:00100000:1.0:1789181455.170810:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:1.0:1789181455.170821:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:11290:x1876092385276928:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181455.170920:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181455.170944:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517560 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f84 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171089:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517567 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171104:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171117:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171128:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb55528351756e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171136:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb55528351756e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171143:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb55528351756e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171236:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171247:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171254:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181455.171297:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789181455.171303:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181455.171322:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171334:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171342:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171349:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517567 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171356:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517567 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171363:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181455.171368:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517567 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171375:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517567 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171395:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:1.0:1789181455.171398:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181455.171403:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517567 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171410:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517567 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171425:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb55528351756e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171432:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb55528351756e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171437:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb55528351756e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171442:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181455.171444:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb55528351756e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171449:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb55528351756e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171456:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6700) 00010000:00010000:1.0:1789181455.171458:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181455.171667:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb55528351756e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171675:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb55528351756e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171715:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517560 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f84 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171770:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f84 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.171777:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:1.0:1789181455.171779:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181455.171782:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12200, rc 0) 00000100:00100000:1.0:1789181455.172054:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:11290:x1876092385276928:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1234us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.172063:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00010000:00010000:1.0:1789181455.884388:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181455.885571:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181455.885578:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181455.885630:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789181455.885645:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789181455.885806:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408434560:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789181455.885920:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10eb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181455.899293:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181455.899329:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385277056 00000100:00100000:1.0:1789181455.899339:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385277056 00000100:00100000:1.0:1789181455.899391:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1789181455.899402:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:11301:x1876092385277056:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789181455.899434:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789181455.899559:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:11301:x1876092385277056:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 158us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.899567:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:3.0:1789181455.900533:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408434560:192.168.202.1@tcp:107:hsm_cdtr.0 00000001:00080000:1.0:1789181455.905487:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00010000:00010000:3.0:1789181455.905630:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905643:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905652:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905658:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181455.905663:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905671:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905686:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c1dc6843c00) 00010000:00010000:3.0:1789181455.905689:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181455.905693:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905699:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351731b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905720:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905756:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905762:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905779:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181455.905782:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905789:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905797:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:3.0:1789181455.905800:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181455.905802:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905808:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb555283517322 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905825:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905830:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905849:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905855:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fa00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181455.905858:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905864:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905881:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6700) 00010000:00010000:3.0:1789181455.905883:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181455.905886:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905893:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517361 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905916:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905922:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905928:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905933:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181455.905936:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905942:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905950:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181455.905952:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181455.905955:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905961:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351746b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905979:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905986:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905992:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.905997:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0030800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181455.905999:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.906005:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.906011:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181455.906014:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181455.906017:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.906023:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351748e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.906034:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.906040:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.906046:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.906056:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fc00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181455.906060:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.906066:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.906074:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:3.0:1789181455.906076:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181455.906078:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181455.906083:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835174d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789181455.906160:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789181455.906184:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c1dd00c10c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789181455.906188:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1df9ce7600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c1dd00c16c0 00000020:00080000:1.0:1789181455.906196:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1df9ce7c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c1cc306ee00 00000020:00080000:3.0:1789181455.906227:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789181455.906619:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789181455.906931:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408434688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789181455.907196:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181455.907254:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408434688 00000100:00100000:2.0:1789181455.907262:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408434688 00000100:00100000:2.0:1789181455.907308:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789181455.907317:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408434688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789181455.907343:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1789181455.907375:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa4be0c, atime: 0x6aa4be0c, ctime: 0x6aa4be0c, blocks: 0x8 00010000:00010000:2.0:1789181455.907382:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb55528351757c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.907399:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1789181455.907404:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181455.907410:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb55528351757c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.907426:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb55528351757c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.907435:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb55528351757c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.907442:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb55528351757c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.907490:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789181455.907517:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181455.907617:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1876092408434688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 300us (421us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789181455.907625:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789181455.907649:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181455.907655:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb55528351757c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.907663:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b000 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181455.907666:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb55528351757c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.907675:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb55528351757c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.907690:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb55528351757c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.907696:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb55528351757c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.907713:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181455.907714:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181455.907716:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181455.908096:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385277184 00000100:00100000:2.0:1789181455.908104:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385277184 00000100:00100000:2.0:1789181455.908167:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:2.0:1789181455.908176:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:11301:x1876092385277184:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789181455.908242:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517583 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908255:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517583 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908264:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517583 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908311:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351758a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908319:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351758a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908596:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351758a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908626:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908634:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908641:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181455.908682:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789181455.908686:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181455.908703:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908739:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517583 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908746:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517583 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908752:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517583 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908757:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181455.908762:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517583 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908770:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517583 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908781:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:2.0:1789181455.908784:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181455.908788:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517583 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908794:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517583 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908806:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351758a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908812:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351758a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908819:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351758a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908830:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181455.908833:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351758a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908850:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351758a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908858:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9c1dc7121900) 00010000:00010000:2.0:1789181455.908861:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181455.908864:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351758a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908870:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351758a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908884:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908889:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908895:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908899:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181455.908901:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908907:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908924:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:2.0:1789181455.908926:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181455.908930:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.908934:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517591 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181455.911091:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1dff852d80/2, rc 0, transno 4294967302 00000100:00100000:3.0:1789181455.911106:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408434688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789181455.913066:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:11301:x1876092385277184:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 4877us (5536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181455.913083:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:1.0:1789181455.919789:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181455.920197:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385277440 00000100:00100000:2.0:1789181455.920209:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385277440 00000100:00100000:2.0:1789181455.920268:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1789181455.920279:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:11301:x1876092385277440:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181455.920302:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181455.920335:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517598 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f8b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920459:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351759f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920475:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351759f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920487:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351759f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181455.920498:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789181455.920717:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351759f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920756:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351759f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920763:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351759f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920771:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181455.920776:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351759f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920785:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351759f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920798:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:2.0:1789181455.920802:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181455.920807:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351759f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920813:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351759f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920867:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517598 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f8b expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920878:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:2.0:1789181455.920880:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181455.920884:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517598 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f8b expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181455.920905:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a800, rc 0) 00000100:00100000:2.0:1789181455.920972:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:11301:x1876092385277440:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 695us (1193us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789181455.920980:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:0.0:1789181455.930853:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181455.930944:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385277568 00000100:00100000:1.0:1789181455.930964:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385277568 00000100:00100000:1.0:1789181455.931031:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1789181455.931042:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:11301:x1876092385277568:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789181455.931078:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789181455.931215:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:11301:x1876092385277568:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 173us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.931223:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1789181455.936413:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181455.936501:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385277824 00000100:00100000:0.0:1789181455.936512:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385277824 00000100:00100000:0.0:1789181455.936574:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:0.0:1789181455.936584:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:11301:x1876092385277824:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181455.936613:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181455.936616:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789181455.936643:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517552 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f7d expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.936663:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181455.936669:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181455.936682:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f92 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789181455.937196:0:9021:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789181455.937343:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835175b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.937356:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835175b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.937367:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835175b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.937449:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f92 expref: 15 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.937464:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835175b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f92 expref: 14 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.937471:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843700) 00010000:00010000:0.0:1789181455.937474:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181455.937476:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679c00, rc 0) 00000100:00100000:0.0:1789181455.937550:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:11301:x1876092385277824:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 967us (1147us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789181455.937557:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:1.0:1789181455.962792:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181455.962909:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385278080 00000100:00100000:0.0:1789181455.962920:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385278080 00000100:00100000:0.0:1789181455.962990:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:0.0:1789181455.963001:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:11301:x1876092385278080:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789181455.963061:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181455.963090:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835175b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f92 expref: 14 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963121:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843700) 00010000:00010000:0.0:1789181455.963133:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181455.963158:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963175:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963198:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963243:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835175c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x7c3f8ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963252:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835175c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7c3f8ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963259:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835175c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7c3f8ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963317:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963325:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175c2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963331:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963336:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181455.963341:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963349:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963357:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181455.963361:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181455.963365:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963377:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb5552835175c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963387:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835175c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7c3f8ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963393:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835175c9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7c3f8ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963399:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835175c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7c3f8ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963404:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181455.963407:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835175c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7c3f8ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963413:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835175c9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7c3f8ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963422:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x7c3f8ca6 (ffff9c1dc6843900) 00010000:00010000:0.0:1789181455.963424:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181455.963427:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835175c9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7c3f8ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.963433:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835175c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7c3f8ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181455.963513:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:11301:x1876092385278080:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 514us (730us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789181455.963520:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1789181455.971697:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181455.971779:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385278208 00000100:00100000:0.0:1789181455.971790:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385278208 00000100:00100000:0.0:1789181455.971867:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:0.0:1789181455.971880:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:11301:x1876092385278208:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181455.971901:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181455.971925:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835175d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7f99 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.971960:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.971976:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.971988:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.973158:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb5552835175d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f99 expref: 15 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.973184:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f99 expref: 14 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.973194:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:0.0:1789181455.973198:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789181455.973202:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc0030800, rc 0) 00000100:00100000:0.0:1789181455.973288:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:11301:x1876092385278208:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1409us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181455.973297:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:1.0:1789181455.977259:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181455.977383:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385278464 00000100:00100000:0.0:1789181455.977395:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385278464 00000100:00100000:0.0:1789181455.977458:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:0.0:1789181455.977468:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:11301:x1876092385278464:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789181455.977546:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.977565:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.977577:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789181455.977770:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1789181455.977781:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411965057155ns, next at 412965054189ns, rc = 0 00000004:00010000:0.0:1789181455.977830:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcda93f0 reply state 000000007971d322 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.977892:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181455.977901:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:0.0:1789181455.977905:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789181455.977909:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181455.978065:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:11301:x1876092385278464:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 598us (813us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789181455.978073:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:3.0:1789181455.981670:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181455.981782:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385278592 00000100:00100000:1.0:1789181455.981793:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385278592 00000100:00100000:1.0:1789181455.981862:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:1.0:1789181455.981873:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:11301:x1876092385278592:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181455.981911:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181455.981932:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835175e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fa0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.981990:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835175e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa0 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.982004:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835175e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa0 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181455.982036:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:1.0:1789181455.982039:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181455.982043:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12a00, rc 0) 00000100:00100000:1.0:1789181455.982129:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:11301:x1876092385278592:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 257us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181455.982136:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:0.0:1789181455.987997:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181455.988648:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385278720 00000100:00100000:3.0:1789181455.988660:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385278720 00000100:00100000:3.0:1789181455.988715:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1789181455.988755:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1876092385278720:12345-192.168.202.1@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789181455.988790:0:8629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:3.0:1789181455.988819:0:8629:0:(genops.c:1384:class_connect()) connect: client 3c4ab02e-ed68-4ee0-b458-d9073baffb59, cookie 0x76fb5552835175ec 00002000:00100000:3.0:1789181455.988831:0:8629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3c4ab02e-ed68-4ee0-b458-d9073baffb59/ffff9c1dc2f1e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789181455.988861:0:8629:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789181455.988944:0:8629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789181455.988977:0:8629:0:(import.c:65:import_set_state_nolock()) ffff9c1dc2f1b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181455.989061:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2392:x1876092385278720:12345-192.168.202.1@tcp:8:lhsmtool_posix.0 Request processed in 337us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181455.989070:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1789181455.991467:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181455.992193:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385278848 00000100:00100000:0.0:1789181455.992219:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385278848 00000100:00100000:0.0:1789181455.992312:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1789181455.992332:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:0:x1876092385278848:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789181455.993183:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789181455.994832:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1789181455.994922:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000100:00100000:1.0:1789181455.995639:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:0:x1876092385278848:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 3301us (4171us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789181455.995651:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:0.0:1789181456.005210:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181456.005373:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385279104 00000100:00100000:2.0:1789181456.005384:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385279104 00000100:00100000:2.0:1789181456.005510:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1789181456.005535:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:11301:x1876092385279104:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789181456.005784:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:11301:x1876092385279104:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 263us (583us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789181456.005793:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00080000:0.0:1789181456.008779:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181456.028184:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181456.028405:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385279360 00000100:00100000:3.0:1789181456.028416:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385279360 00000100:00100000:3.0:1789181456.028476:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:3.0:1789181456.028487:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:11301:x1876092385279360:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789181456.028601:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:11301:x1876092385279360:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 116us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181456.028608:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:2.0:1789181456.043622:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181456.043791:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385279488 00000100:00100000:3.0:1789181456.043801:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385279488 00000100:00100000:3.0:1789181456.043873:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:3.0:1789181456.043885:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:11301:x1876092385279488:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181456.043916:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181456.043937:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb5552835175f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fa7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.044022:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835175fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.044038:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835175fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.044063:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835175fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181456.044112:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181456.044130:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835175fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.044157:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb5552835175f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa7 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.044175:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835175fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa7 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.044185:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:3.0:1789181456.044188:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789181456.044193:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fc00, rc 0) 00000100:00100000:1.0:1789181456.045984:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:11301:x1876092385279488:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2091us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181456.045995:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:3.0:1789181456.060810:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181456.060913:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385279616 00000100:00100000:1.0:1789181456.060924:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385279616 00000100:00100000:1.0:1789181456.060983:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:1.0:1789181456.060994:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385279616:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181456.061011:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181456.061033:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df27c8cc/0x76fb555283517601 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fae expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181456.061058:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4be0f, blocks: 0x0 00010000:00010000:1.0:1789181456.061078:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789181456.061082:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181456.061093:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df27c8cc/0x76fb555283517601 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fae expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.061136:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df27c8cc/0x76fb555283517601 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fae expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.061151:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13000, rc 0) 00000100:00100000:1.0:1789181456.061214:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385279616:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 222us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181456.061221:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1789181456.073946:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181456.073983:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385279872 00000100:00100000:3.0:1789181456.073995:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385279872 00000100:00100000:3.0:1789181456.074066:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:3.0:1789181456.074076:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:11301:x1876092385279872:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789181456.074202:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:11301:x1876092385279872:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 126us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181456.074210:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:3.0:1789181456.077863:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181456.077971:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385280000 00000100:00100000:0.0:1789181456.077984:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385280000 00000100:00100000:0.0:1789181456.078048:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1789181456.078059:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:11301:x1876092385280000:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181456.078081:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181456.078106:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fb5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.078140:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df27c8cc/0x76fb555283517601 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fae expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.078151:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181456.078155:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181456.078161:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.078193:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df27c8cc/0x76fb555283517601 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fae expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.078238:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df27c8cc/0x76fb555283517601 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fae expref: 7 pid: 8435 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181456.078254:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408434816:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181456.078609:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181456.083431:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181456.083462:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385280128 00000100:00100000:0.0:1789181456.083471:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385280128 00010000:00010000:0.0:1789181456.083512:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df27c8cc/0x76fb555283517601 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fae expref: 8 pid: 8435 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181456.083549:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1789181456.083559:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385280128:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181456.083575:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181456.083612:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df27c8cc/0x76fb555283517601 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fae expref: 8 pid: 8435 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.083627:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df27c8cc/0x76fb555283517601 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fae expref: 8 pid: 8435 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.083659:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181456.083664:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181456.083673:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.083700:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.083767:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181456.083784:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f03480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1876092408434944:192.168.202.1@tcp:105: 00000100:00100000:0.0:1789181456.083873:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31240 going to sleep for 11 seconds 00010000:00010000:3.0:1789181456.086576:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df27c8cc/0x76fb555283517601 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fae expref: 8 pid: 8435 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181456.086677:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408434816:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181456.086710:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.086744:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679c00, rc 0) 00000100:00100000:3.0:1789181456.086809:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:11301:x1876092385280000:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 8751us (8957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181456.086819:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:1.0:1789181456.098291:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f03480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1876092408434944:192.168.202.1@tcp:105: 00010000:00010000:1.0:1789181456.098321:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181456.098384:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385280128:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 14824us (14961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181456.098395:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1789181456.115935:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181456.116028:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385280256 00000100:00100000:1.0:1789181456.116040:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385280256 00002000:00100000:1.0:1789181456.116092:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c1dff850380 x1876092385280256/t0(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:587/0 lens 504/0 e 0 to 0 dl 1789181467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181456.116105:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dff850380 with x1876092385280256 ext(0->8) 00002000:00010000:1.0:1789181456.116111:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1dff850380 00000100:00100000:1.0:1789181456.116149:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1789181456.116160:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385280256:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000040:00080000:3.0:1789181456.117959:0:14212:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181456.117968:0:14212:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181456.117990:0:14212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789181456.117995:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181456.132120:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385280256:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 15946us (16180us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789181456.132143:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00002000:00100000:2.0:1789181456.132158:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c1dff850380 x1876092385280256/t4294967303(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:587/0 lens 504/448 e 0 to 0 dl 1789181467 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181456.132170:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dff850380 with x1876092385280256 ext(0->8) 00002000:00010000:2.0:1789181456.132177:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1dff850380 00000100:00100000:3.0:1789181456.135300:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181456.148166:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385280384 00000100:00100000:0.0:1789181456.148182:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385280384 00000100:00100000:0.0:1789181456.148262:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:0.0:1789181456.148274:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:11301:x1876092385280384:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789181456.174602:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1789181456.174624:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:3.0:1789181456.174752:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.174768:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.174777:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.174784:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0031600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181456.174789:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.174799:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.174826:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:3.0:1789181456.174829:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789181456.174848:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.174856:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835175de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181456.182669:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408435072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789181456.182767:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181456.187279:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408435072 00000100:00100000:0.0:1789181456.187294:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408435072 00000100:00100000:0.0:1789181456.187414:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181456.187425:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408435072:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1789181456.187518:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1789181456.187548:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789181456.187558:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00002000:00010000:0.0:1789181456.187573:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789181456.187577:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789181455 00002000:00010000:0.0:1789181456.187580:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789181456.187582:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789181455 -> 1789181455 00002000:00010000:0.0:1789181456.187585:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789181456.187669:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408435072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 246us (4902us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789181456.187677:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789181456.187713:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1dd92aa300/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789181456.187746:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408435072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789181456.187811:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:11301:x1876092385280384:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 39537us (52518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181456.187819:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1789181456.190843:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181456.190966:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385280512 00000100:00100000:0.0:1789181456.190977:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385280512 00000100:00100000:0.0:1789181456.191032:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1789181456.191042:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385280512:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789181456.194557:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1789181456.194574:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1789181456.194888:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385280512:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 3840us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181456.194900:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1789181456.213754:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181456.214739:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385280768 00000100:00100000:0.0:1789181456.214752:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385280768 00000100:00100000:0.0:1789181456.214841:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1789181456.214853:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:11301:x1876092385280768:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789181456.214916:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181456.214946:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb5552835175fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa7 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.214964:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:0.0:1789181456.214970:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181456.215001:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.215018:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.215028:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181456.215463:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b77a3552 reply state 00000000efc79acd transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.215477:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.215484:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:0.0:1789181456.215486:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181456.215490:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181456.215606:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:11301:x1876092385280768:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 754us (1861us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789181456.215616:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:1.0:1789181456.233302:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181456.233386:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385280896 00000100:00100000:3.0:1789181456.233396:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385280896 00000100:00100000:3.0:1789181456.233452:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1789181456.233462:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385280896:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789181456.233619:0:8629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789181456.233622:0:8629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789181455 -> 1789181454 00002000:00010000:3.0:1789181456.233625:0:8629:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789181452 00002000:00010000:3.0:1789181456.233627:0:8629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789181455 -> 1789181454 00002000:00010000:3.0:1789181456.233629:0:8629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789181456.233685:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385280896:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 224us (391us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789181456.233692:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:2.0:1789181456.238030:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181456.238758:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385281152 00000100:00100000:1.0:1789181456.238770:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385281152 00000100:00100000:1.0:1789181456.238854:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:1.0:1789181456.238867:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:11301:x1876092385281152:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789181456.238967:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.238989:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f99 expref: 15 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.239001:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.239043:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f99 expref: 15 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.239060:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f99 expref: 15 pid: 9021 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181456.239076:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408435200:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181456.239193:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181456.244543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181456.244778:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408435200:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181456.244812:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181456.247300:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385281280 00000100:00100000:3.0:1789181456.247315:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385281280 00010000:00010000:3.0:1789181456.247358:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f99 expref: 16 pid: 9021 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181456.247420:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1789181456.247429:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:2394:x1876092385281280:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181456.247445:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181456.247451:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f99 expref: 16 pid: 9021 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.247464:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f99 expref: 16 pid: 9021 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.247488:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835175d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f99 expref: 16 pid: 9021 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.247504:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:3.0:1789181456.247510:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.247520:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.247528:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.247552:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181456.247579:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.247599:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181456.247634:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:2394:x1876092385281280:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 205us (3098us total) trans 0 rc 0/0 00010000:00010000:1.0:1789181456.247640:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.247649:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181456.247653:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00010000:00010000:1.0:1789181456.247656:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.247663:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181456.247668:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.247675:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.247686:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:1.0:1789181456.247689:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789181456.247693:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.247699:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517616 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181456.247780:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:11301:x1876092385281152:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 8916us (9761us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789181456.247789:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:3.0:1789181456.251405:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181456.251552:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385281408 00000100:00100000:1.0:1789181456.251563:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385281408 00000100:00100000:1.0:1789181456.251635:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:1.0:1789181456.251646:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385281408:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789181456.251697:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.251719:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.251755:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181456.251759:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181456.251764:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.251799:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.251813:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 7 pid: 8437 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181456.251828:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408435328:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181456.251920:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1789181456.256972:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408435328:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181456.257006:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181456.258496:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181456.258577:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385281536 00000100:00100000:1.0:1789181456.258595:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385281536 00010000:00010000:1.0:1789181456.258634:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 8 pid: 8437 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181456.258682:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1789181456.258692:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385281536:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181456.258710:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181456.258759:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 8 pid: 8437 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.258773:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 8 pid: 8437 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.258796:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283517608 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fb5 expref: 8 pid: 8437 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.258814:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181456.258818:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181456.258824:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.258849:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.258901:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181456.258958:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385281536:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 266us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181456.258965:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00010000:00010000:1.0:1789181456.258993:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.259002:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.259021:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.259029:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.259037:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.259044:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181456.259049:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.259058:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.259080:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.259088:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000112b75ad/0x76fb55528351761d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181456.259465:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385281408:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 7820us (8070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181456.259474:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:2.0:1789181456.282483:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181456.282957:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385281792 00000100:00100000:0.0:1789181456.282969:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385281792 00000100:00100000:0.0:1789181456.283033:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:0.0:1789181456.283044:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:11301:x1876092385281792:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789181456.283135:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.283154:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f3e expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.283165:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.283202:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f3e expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.283399:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f3e expref: 14 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181456.283417:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f00000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408435456:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181456.283539:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181456.292318:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f00000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408435456:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181456.292356:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181456.305272:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181456.305379:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385281920 00000100:00100000:0.0:1789181456.305390:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385281920 00010000:00010000:0.0:1789181456.305434:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f3e expref: 15 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181456.305473:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:0.0:1789181456.305482:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:2394:x1876092385281920:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181456.305498:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181456.305505:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f3e expref: 15 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.305520:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f3e expref: 15 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.305542:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517464 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f3e expref: 15 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.305576:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:0.0:1789181456.305581:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.305603:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.305613:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.305646:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181456.305705:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:2394:x1876092385281920:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 223us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181456.305713:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00010000:00010000:2.0:1789181456.306689:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.306703:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.306923:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.306942:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835175e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa0 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.306951:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.306997:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835175e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa0 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.307012:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835175e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa0 expref: 14 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181456.307027:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408435584:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181456.307106:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181456.333307:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408435584:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181456.333336:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181456.342381:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181456.342425:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385282048 00000100:00100000:1.0:1789181456.342436:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385282048 00010000:00010000:1.0:1789181456.342476:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835175e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa0 expref: 15 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181456.342513:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1789181456.342523:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:2393:x1876092385282048:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181456.342557:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181456.342565:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835175e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa0 expref: 15 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.342578:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835175e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa0 expref: 15 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.342610:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb5552835175e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fa0 expref: 15 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.342634:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:1.0:1789181456.342641:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.342650:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.342658:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.342682:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181456.342752:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:2393:x1876092385282048:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 230us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181456.342759:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00010000:00010000:3.0:1789181456.343453:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181456.343464:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181456.343576:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1789181456.343718:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1789181456.343788:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1789181456.343895:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1876092408435712:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789181456.343969:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181456.344003:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd8eb9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181456.344750:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408435712 00000100:00100000:1.0:1789181456.344761:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408435712 00000100:00100000:1.0:1789181456.344819:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789181456.344827:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1876092408435712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789181456.344985:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1876092408435712:12345-0@lo:1000:mdt00_002.0 Request processed in 157us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181456.344993:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789181456.345048:0:6523:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789181456.345055:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1dd92aa300, transno 4294967304 00000100:00100000:1.0:1789181456.345069:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1876092408435712:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789181456.345243:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1789181456.345310:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1876092408435840:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789181456.345363:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181456.345384:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc3042600 going to sleep for 11 seconds 00000100:00100000:3.0:1789181456.345854:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408435840 00000100:00100000:3.0:1789181456.345861:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408435840 00000100:00100000:3.0:1789181456.345908:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789181456.345917:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1876092408435840:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789181456.346051:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1876092408435840:12345-0@lo:1000:mdt00_002.0 Request processed in 135us (686us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789181456.346059:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789181456.347290:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1876092408435840:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789181456.347340:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347352:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347360:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347366:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181456.347371:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347379:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347395:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:1.0:1789181456.347399:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181456.347404:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347410:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb55528351762b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347444:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517559 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347450:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517559 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347471:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517559 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347477:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181456.347480:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517559 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347487:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517559 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347496:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:1.0:1789181456.347499:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181456.347502:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517559 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347508:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517559 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347532:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347549:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f84 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347558:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347592:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f84 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.347621:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f84 expref: 17 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181456.347642:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408435968:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181456.347766:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10ebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181456.353394:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408435968:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181456.353433:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181456.373486:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181456.373527:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385282176 00000100:00100000:0.0:1789181456.373537:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385282176 00010000:00010000:0.0:1789181456.373587:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f84 expref: 18 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181456.373643:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1789181456.373653:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:2395:x1876092385282176:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181456.373669:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181456.373676:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f84 expref: 18 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.373690:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f84 expref: 18 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.373939:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517575 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7f84 expref: 18 pid: 6522 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.373963:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:0.0:1789181456.373971:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.373984:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.373993:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374030:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181456.374104:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:2395:x1876092385282176:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 440us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181456.374112:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00010000:00010000:0.0:1789181456.374143:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374150:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374163:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374169:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374176:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374189:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181456.374193:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374202:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374210:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:0.0:1789181456.374213:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181456.374217:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374222:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517632 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374232:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374238:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374244:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374249:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181456.374252:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374259:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374278:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dcf5c0400) 00010000:00010000:0.0:1789181456.374280:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789181456.374283:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181456.374289:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb555283517624 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181456.374432:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:11301:x1876092385281792:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 91389us (91960us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789181456.374440:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00000020:00080000:0.0:1789181456.374444:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789181456.374631:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181456.374637:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181456.374653:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789181456.374661:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181456.387162:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181456.388076:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385282432 00000100:00100000:2.0:1789181456.388670:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385282432 00000100:00100000:2.0:1789181456.388764:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1789181456.388776:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:11301:x1876092385282432:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789181456.389717:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789181456.389790:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1789181456.389847:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.389868:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.389882:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.389891:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.389897:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.389904:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181456.389925:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181456.390708:0:13192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181456.390719:0:13192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.390745:0:13192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181456.390749:0:13192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.390759:0:13192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.390775:0:13192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:1.0:1789181456.390778:0:13192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789181456.390782:0:13192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.390787:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517639 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181456.390800:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181456.390801:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181456.390803:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181456.392239:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:11301:x1876092385282432:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 3450us (5075us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789181456.392254:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000020:00080000:2.0:1789181456.392262:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789181456.910045:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181457.165258:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181457.165286:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408436096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181457.165371:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181457.165527:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408436096 00000100:00100000:3.0:1789181457.165550:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408436096 00000100:00100000:3.0:1789181457.165610:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789181457.165618:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408436096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181457.165653:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789181457.165702:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408436096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181457.165709:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789181457.165872:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408436096:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789181457.932231:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181458.263318:0:14264:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181458.263328:0:14264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181458.263352:0:14264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789181458.263359:0:14264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181458.439930:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181458.440505:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385282688 00000100:00100000:3.0:1789181458.440518:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385282688 00000100:00100000:3.0:1789181458.440607:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:3.0:1789181458.440619:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:11319:x1876092385282688:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181458.440644:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181458.440667:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fbc expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.440823:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517647 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.440845:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517647 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.440859:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517647 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181458.440870:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000100:00080000:0.0:1789181458.441066:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789181458.441890:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fbc expref: 21 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.441982:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517647 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fbc expref: 20 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.441992:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:2.0:1789181458.441996:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181458.441999:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085ec00, rc 0) 00000100:00100000:2.0:1789181458.442286:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:11319:x1876092385282688:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1455us (2155us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789181458.442296:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1789181458.447518:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181458.447670:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385282816 00000100:00100000:3.0:1789181458.447681:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385282816 00000100:00100000:3.0:1789181458.447765:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:3.0:1789181458.447776:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:11319:x1876092385282816:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1789181458.447883:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517655 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448156:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517655 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448171:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517655 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448190:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb55528351765c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448197:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb55528351765c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448203:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb55528351765c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448291:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448300:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448307:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181458.448355:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448369:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517655 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448385:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517655 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448391:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517655 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448398:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fa00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181458.448402:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517655 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448409:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517655 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448422:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:3.0:1789181458.448426:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181458.448431:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517655 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448442:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517655 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448454:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb55528351765c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448459:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb55528351765c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448465:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb55528351765c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448471:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ea00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181458.448480:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb55528351765c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448486:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb55528351765c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448494:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6700) 00010000:00010000:3.0:1789181458.448496:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181458.448499:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb55528351765c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448504:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb55528351765c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448519:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448524:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448529:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448533:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ee00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181458.448536:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448541:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448547:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dfadc6f00) 00010000:00010000:3.0:1789181458.448549:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181458.448558:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.448563:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517663 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181458.449423:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:11319:x1876092385282816:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1642us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181458.449434:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:0.0:1789181458.528923:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.528963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385283072 00000100:00100000:0.0:1789181458.528973:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385283072 00000100:00100000:0.0:1789181458.529028:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1789181458.529038:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:11322:x1876092385283072:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181458.529069:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181458.529102:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351766a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fc3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.529177:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517671 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.529193:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517671 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.529204:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517671 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.531671:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517678 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.531685:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.531696:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.531850:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.531860:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.531868:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181458.531879:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789181458.531977:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517671 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.531985:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517671 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.531992:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517671 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.531999:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181458.532003:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517671 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.532011:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517671 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.532024:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181458.532028:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181458.532033:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517671 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.532041:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679a00/0x76fb555283517671 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.532055:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.532061:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517678 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.534630:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517678 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.534654:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181458.534669:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517678 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.534680:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517678 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.534697:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dd82e2100) 00010000:00010000:0.0:1789181458.534701:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181458.534705:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517678 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.534712:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679000/0x76fb555283517678 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.534819:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb55528351766a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fc3 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.534835:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fc3 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.534843:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:0.0:1789181458.534846:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181458.534849:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679c00, rc 0) 00000100:00100000:0.0:1789181458.534936:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11322:x1876092385283072:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 5898us (6022us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789181458.534946:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:0.0:1789181458.546415:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.546458:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385283200 00000100:00100000:0.0:1789181458.546467:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385283200 00000100:00100000:0.0:1789181458.546521:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:0.0:1789181458.546541:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11322:x1876092385283200:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1789181458.546619:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb55528351768d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.546639:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb55528351768d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.546651:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb55528351768d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.546689:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb55528351768d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.546697:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb55528351768d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.546704:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb55528351768d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.546710:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181458.546714:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb55528351768d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.546738:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb55528351768d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.546752:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:0.0:1789181458.546755:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181458.546760:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb55528351768d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.546766:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb55528351768d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181458.546861:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11322:x1876092385283200:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 321us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181458.546869:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1789181458.553194:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181458.553236:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385283456 00000100:00100000:2.0:1789181458.553246:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385283456 00000100:00100000:2.0:1789181458.553304:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1789181458.553315:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd13d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11322:x1876092385283456:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1789181458.553545:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd13d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:11322:x1876092385283456:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 231us (360us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789181458.553553:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:0.0:1789181458.612255:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181458.612327:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385283712 00000100:00100000:2.0:1789181458.612338:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385283712 00000100:00100000:2.0:1789181458.612400:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:2.0:1789181458.612411:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:10840:x1876092385283712:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1789181458.612454:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181458.612477:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517694 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.612601:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.612617:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fc3 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.612626:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.612860:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fc3 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.612876:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fc3 expref: 24 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181458.612890:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408436224:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181458.613001:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181458.615620:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408436224:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181458.615649:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181458.617683:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181458.617828:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385283840 00000100:00100000:1.0:1789181458.617856:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385283840 00010000:00010000:1.0:1789181458.617910:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fc3 expref: 25 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181458.617954:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:1.0:1789181458.617965:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:2394:x1876092385283840:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181458.617981:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181458.617988:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fc3 expref: 25 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.618003:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fc3 expref: 25 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.618026:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb55528351767f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fc3 expref: 25 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.618046:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:1.0:1789181458.618052:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.618063:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.618071:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.618105:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181458.618176:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:2394:x1876092385283840:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 211us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181458.618193:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00010000:00010000:0.0:1789181458.618256:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.618266:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181458.618289:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789181458.618449:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517694 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fca expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.618476:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fca expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.618484:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:0.0:1789181458.618486:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789181458.618489:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084bc00, rc 0) 00000100:00100000:0.0:1789181458.618517:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:10840:x1876092385283712:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6109us (6272us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1789181458.618534:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:2.0:1789181458.621926:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.622093:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385283968 00000100:00100000:0.0:1789181458.622104:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385283968 00000100:00100000:0.0:1789181458.622173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:0.0:1789181458.622185:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:10840:x1876092385283968:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1789181458.622211:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181458.622235:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb5552835176a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fd1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.622272:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb5552835176b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.622287:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb5552835176b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.622298:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb5552835176b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.622436:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb5552835176a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fd1 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.622455:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb5552835176b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fd1 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.622477:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:0.0:1789181458.622487:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789181458.622490:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1000, rc 0) 00000100:00100000:0.0:1789181458.622557:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:10840:x1876092385283968:12345-192.168.202.1@tcp:101:bash.0 Request processed in 374us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181458.622571:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:2.0:1789181458.625133:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.625215:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385284224 00000100:00100000:0.0:1789181458.625226:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385284224 00000100:00100000:0.0:1789181458.625286:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:0.0:1789181458.625296:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:10840:x1876092385284224:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:0.0:1789181458.625549:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.625566:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.625577:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181458.625619:0:9021:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1789181458.625644:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000247babda reply state 0000000029bbf520 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.625657:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.625665:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:0.0:1789181458.625668:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181458.625672:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789181458.625709:0:9021:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1789181458.625870:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:10840:x1876092385284224:12345-192.168.202.1@tcp:36:bash.0 Request processed in 574us (750us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789181458.625878:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00000020:00080000:0.0:1789181458.625883:0:9021:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789181458.627713:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.628072:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385284352 00000100:00100000:0.0:1789181458.628104:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385284352 00000100:00100000:0.0:1789181458.628212:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:0.0:1789181458.628222:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:10840:x1876092385284352:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1789181458.628248:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181458.628270:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb5552835176be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fd8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.628343:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb5552835176be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fd8 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.628357:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb5552835176be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fd8 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.628375:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:0.0:1789181458.628378:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789181458.628382:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0a00, rc 0) 00000100:00100000:0.0:1789181458.628445:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:10840:x1876092385284352:12345-192.168.202.1@tcp:101:bash.0 Request processed in 224us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181458.628451:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:3.0:1789181458.635782:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181458.635863:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385284480 00000100:00100000:1.0:1789181458.635873:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385284480 00000100:00100000:1.0:1789181458.635958:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1789181458.635971:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:10840:x1876092385284480:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181458.635993:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181458.636016:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c853ff7/0x76fb5552835176c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fdf expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181458.636044:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4be0e, atime: 0x6aa4be0c, ctime: 0x6aa4be0e, blocks: 0x8 00010000:00010000:1.0:1789181458.636071:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1789181458.636076:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181458.636085:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c853ff7/0x76fb5552835176c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fdf expref: 7 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.636104:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c853ff7/0x76fb5552835176c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fdf expref: 7 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.636117:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12c00, rc 0) 00000100:00100000:1.0:1789181458.636185:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:10840:x1876092385284480:12345-192.168.202.1@tcp:101:bash.0 Request processed in 217us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181458.636193:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00080000:0.0:1789181458.636538:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181458.638520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181458.639311:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385284608 00000100:00100000:3.0:1789181458.639320:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385284608 00002000:00010000:3.0:1789181458.639366:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789181458.639372:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dc2f02300 with x1876092385284608 ext(0->18446744073709551615) 00002000:00010000:3.0:1789181458.639384:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1dc2f02300. 00000100:00100000:3.0:1789181458.640159:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1789181458.640175:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2395:x1876092385284608:12345-192.168.202.1@tcp:10:bash.0 00002000:00010000:3.0:1789181458.640467:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789181458.640470:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789181454 -> 1789181458 00002000:00010000:3.0:1789181458.640472:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789181452 -> 1789181452 00002000:00010000:3.0:1789181458.640473:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789181454 -> 1789181458 00002000:00010000:3.0:1789181458.640475:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789181458.640531:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2395:x1876092385284608:12345-192.168.202.1@tcp:10:bash.0 Request processed in 361us (2018us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789181458.640539:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00010000:3.0:1789181458.640544:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789181458.640547:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dc2f02300 with x1876092385284608 ext(0->18446744073709551615) 00002000:00010000:3.0:1789181458.640552:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1dc2f02300. 00000100:00100000:3.0:1789181458.700049:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181458.700049:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181458.700078:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408436352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181458.700078:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408436480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181458.702792:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181458.702863:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408436480 00000100:00100000:2.0:1789181458.702874:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408436480 00000100:00080000:0.0:1789181458.702921:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181458.703126:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789181458.703138:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876092408436480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181458.703189:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181458.703249:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876092408436480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181458.703256:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789181458.703334:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408436480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181458.703921:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181458.704130:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408436352 00000100:00100000:0.0:1789181458.704136:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408436352 00000100:00100000:0.0:1789181458.704197:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789181458.704206:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408436352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181458.704221:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181458.704260:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408436352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181458.704265:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789181458.704354:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408436352:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789181458.704418:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181458.704525:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.704884:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385284736 00000100:00100000:0.0:1789181458.704890:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385284736 00000100:00100000:0.0:1789181458.705094:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:0.0:1789181458.705104:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:11336:x1876092385284736:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1789181458.705175:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb5552835176cc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705194:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb5552835176cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705205:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb5552835176cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705221:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb5552835176d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705228:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb5552835176d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705234:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb5552835176d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705308:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705330:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705338:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181458.705390:0:9021:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705402:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb5552835176cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705409:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb5552835176cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705415:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb5552835176cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705422:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181458.705426:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb5552835176cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705433:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb5552835176cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705446:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181458.705448:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181458.705453:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb5552835176cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705458:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb5552835176cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705496:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb5552835176d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705502:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb5552835176d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705508:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb5552835176d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705513:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181458.705516:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb5552835176d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705522:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb5552835176d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705529:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dd82e2100) 00010000:00010000:0.0:1789181458.705531:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181458.705534:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb5552835176d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705540:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb5552835176d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705555:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705562:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705567:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705578:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181458.705582:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705588:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705596:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:0.0:1789181458.705598:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181458.705601:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.705607:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb5552835176da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181458.705700:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:11336:x1876092385284736:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 597us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181458.705707:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:0.0:1789181458.745886:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181458.746053:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385284992 00000100:00100000:3.0:1789181458.746067:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385284992 00000100:00100000:3.0:1789181458.746184:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:3.0:1789181458.746197:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:11339:x1876092385284992:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181458.746220:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181458.746242:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835176e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fe6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.746315:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835176e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.746330:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835176e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.746342:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835176e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.746357:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835176ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.746364:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835176ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.746370:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835176ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747156:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835176f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747169:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835176f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747177:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835176f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181458.747188:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789181458.747277:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835176e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747285:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835176e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747291:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835176e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747297:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ea00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181458.747302:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835176e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747310:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835176e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747323:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:3.0:1789181458.747326:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181458.747330:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835176e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747349:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835176e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747364:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835176ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747370:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835176ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747375:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835176ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747381:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fa00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181458.747384:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835176ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747390:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835176ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747397:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6f00) 00010000:00010000:3.0:1789181458.747400:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181458.747402:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835176ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747409:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835176ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747459:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835176e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fe6 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747872:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835176f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fe6 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.747886:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:3.0:1789181458.747889:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789181458.747892:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f000, rc 0) 00000100:00100000:3.0:1789181458.747989:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:11339:x1876092385284992:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1794us (2109us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789181458.747997:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:3.0:1789181458.753795:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181458.753895:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385285120 00000100:00100000:2.0:1789181458.753905:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385285120 00000100:00100000:2.0:1789181458.753970:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:2.0:1789181458.753980:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:11339:x1876092385285120:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:2.0:1789181458.754054:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.754073:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fca expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.754084:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.754121:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fca expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.754135:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fca expref: 32 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181458.754148:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f00000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408436608:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181458.754248:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181458.757925:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.758095:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f00000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408436608:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181458.758128:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181458.758206:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385285376 00000100:00100000:1.0:1789181458.758229:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385285376 00000100:00100000:1.0:1789181458.758296:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1789181458.758308:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+33:6166:x1876092385285376:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789181458.758614:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+34:6166:x1876092385285376:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 307us (698us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789181458.758622:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1789181458.761850:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.762073:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385285504 00000100:00100000:0.0:1789181458.762085:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385285504 00010000:00010000:0.0:1789181458.762126:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fca expref: 34 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181458.762177:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:0.0:1789181458.762203:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+34:2393:x1876092385285504:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181458.762221:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181458.762229:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fca expref: 34 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.762245:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fca expref: 34 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.762268:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb55528351769b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fca expref: 34 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.762285:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:0.0:1789181458.762290:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.762301:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.762310:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.762346:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181458.762412:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+33:2393:x1876092385285504:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 211us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181458.762420:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00010000:00010000:2.0:1789181458.762499:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.762516:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.762559:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.762567:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.762574:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.762581:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181458.762586:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.762595:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.762606:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:2.0:1789181458.762609:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181458.762614:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.762620:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517704 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181458.762677:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:11339:x1876092385285120:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 8698us (8893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181458.762686:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:3.0:1789181458.767234:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181458.767505:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385285760 00000100:00100000:1.0:1789181458.767516:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385285760 00000100:00100000:1.0:1789181458.767586:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1789181458.767598:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:11339:x1876092385285760:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1789181458.767917:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+33:11339:x1876092385285760:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 320us (692us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789181458.767925:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:3.0:1789181458.793712:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.793914:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385285888 00000100:00100000:0.0:1789181458.793927:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385285888 00000100:00100000:0.0:1789181458.793986:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 384 00000100:00100000:0.0:1789181458.793998:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385285888:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181458.794092:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385285888:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 96us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181458.794101:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 384 00000100:00100000:3.0:1789181458.798301:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181458.798351:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181458.798387:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181458.798420:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181458.798510:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385286016 00000100:00100000:1.0:1789181458.798521:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385286016 00000100:00100000:1.0:1789181458.798600:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385286272 00000100:00100000:1.0:1789181458.798603:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385286272 00000100:00100000:1.0:1789181458.798622:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385286400 00000100:00100000:1.0:1789181458.798625:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385286400 00000100:00100000:1.0:1789181458.798652:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 302 00000100:00100000:1.0:1789181458.798671:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385286016:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181458.798775:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385286016:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 106us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181458.798783:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 302 00000100:00100000:1.0:1789181458.798803:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 303 00000100:00100000:1.0:1789181458.798824:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385286272:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181458.798861:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385286272:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 51us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181458.798867:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 303 00000100:00100000:1.0:1789181458.798879:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 304 00000100:00100000:1.0:1789181458.798885:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385286400:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181458.798906:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385286400:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181458.798911:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 304 00000100:00080000:3.0:1789181458.799481:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181458.799486:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181458.799780:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385286144 00000100:00100000:2.0:1789181458.799787:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385286144 00000100:00100000:2.0:1789181458.799853:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:2.0:1789181458.799862:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385286144:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181458.799919:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385286144:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 58us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181458.799925:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00080000:3.0:1789181458.800264:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181458.880587:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181458.880924:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385286656 00000100:00100000:1.0:1789181458.880944:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385286656 00000100:00100000:1.0:1789181458.881014:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:1.0:1789181458.881026:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+33:11350:x1876092385286656:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:1.0:1789181458.881053:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181458.881075:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb55528351770b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7fed expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881152:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517712 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881168:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881179:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881193:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517719 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881218:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881225:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881346:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517720 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881355:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881363:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181458.881373:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789181458.881455:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881476:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517712 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881484:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517712 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881490:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181458.881494:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517712 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881500:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517712 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881522:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:1.0:1789181458.881526:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181458.881531:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517712 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881537:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517712 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881552:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881557:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517719 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881562:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881578:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181458.881581:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881587:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517719 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881594:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dd12f1e00) 00010000:00010000:1.0:1789181458.881596:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181458.881599:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517719 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.881604:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517719 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.882271:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb55528351770b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fed expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.882289:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fed expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.882298:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:1.0:1789181458.882300:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181458.882303:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13800, rc 0) 00000100:00100000:1.0:1789181458.882380:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:11350:x1876092385286656:12345-192.168.202.1@tcp:101:cat.0 Request processed in 1356us (1812us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789181458.882388:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:0.0:1789181458.889757:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181458.889864:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385286912 00000100:00100000:1.0:1789181458.889875:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385286912 00000100:00100000:1.0:1789181458.889939:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1789181458.889951:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:11350:x1876092385286912:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1789181458.890307:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+36:11350:x1876092385286912:12345-192.168.202.1@tcp:35:cat.0 Request processed in 356us (592us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789181458.890316:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1789181458.919991:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.920151:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385287168 00000100:00100000:0.0:1789181458.920163:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385287168 00000100:00100000:0.0:1789181458.920226:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:0.0:1789181458.920237:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+36:11351:x1876092385287168:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:0.0:1789181458.920297:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789181458.920325:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb5552835176be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fd8 expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.920348:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517720 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fed expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.920360:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb5552835176f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fe6 expref: 34 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.920371:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb5552835176b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fd1 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.920381:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:0.0:1789181458.920386:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181458.920407:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351772e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.920422:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351772e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.920445:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351772e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.920459:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.920898:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.920907:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.920999:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb55528351773c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921008:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb55528351773c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921014:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb55528351773c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789181458.921256:0:9021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789181458.921267:0:9021:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414908542928ns, next at 415908540125ns, rc = 0 00010000:00010000:0.0:1789181458.921315:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921324:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921331:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921350:0:9021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921356:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921362:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921387:0:9021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789181458.921408:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb55528351773c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921414:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb55528351773c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921421:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb55528351773c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921426:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181458.921430:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb55528351773c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921436:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb55528351773c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921446:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:0.0:1789181458.921449:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789181458.921454:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb55528351773c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921483:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb55528351773c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921500:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351772e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921506:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351772e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921511:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351772e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921515:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181458.921518:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351772e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921523:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351772e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921530:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181458.921532:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181458.921535:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351772e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921539:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351772e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181458.921547:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000facc013e reply state 00000000e3ea252d transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921557:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.921582:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dd82e2100) 00010000:00010000:0.0:1789181458.921585:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181458.921588:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789181458.922763:0:13192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181458.922773:0:13192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.922782:0:13192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181458.922786:0:13192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.922818:0:13192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.922831:0:13192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:1.0:1789181458.922833:0:13192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789181458.922838:0:13192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.922843:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517743 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.922857:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181458.922858:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181458.922860:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181458.924170:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+34:11351:x1876092385287168:12345-192.168.202.1@tcp:36:rm.0 Request processed in 3922us (4238us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789181458.924182:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00010000:00010000:1.0:1789181458.956564:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181458.978479:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181458.978596:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385287424 00000100:00100000:0.0:1789181458.978609:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385287424 00000100:00100000:0.0:1789181458.978688:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:0.0:1789181458.978699:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+34:11357:x1876092385287424:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1789181458.979055:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181458.979079:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351774a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7ff4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.979185:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517751 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.979200:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517751 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.979212:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517751 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.979222:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.979229:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.979252:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789181458.979597:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789181458.980291:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980305:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980314:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980346:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517751 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980353:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517751 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980360:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517751 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980365:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181458.980370:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517751 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980377:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517751 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980388:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181458.980391:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181458.980405:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517751 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980412:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517751 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181458.980425:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddaf5455 reply state 000000005037820c transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980435:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980441:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dd82e2100) 00010000:00010000:0.0:1789181458.980444:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181458.980446:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789181458.980474:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb55528351774a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ff4 expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980487:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ff4 expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181458.980494:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd82e2e00) 00010000:00010000:0.0:1789181458.980497:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181458.980499:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0a00, rc 0) 00000100:00100000:0.0:1789181458.981342:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:11357:x1876092385287424:12345-192.168.202.1@tcp:101:bash.0 Request processed in 2641us (2886us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789181458.981352:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:1.0:1789181458.985704:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181458.986064:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385287552 00000100:00100000:3.0:1789181458.986077:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385287552 00000100:00100000:3.0:1789181458.986141:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1789181458.986153:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2396:x1876092385287552:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1789181458.986173:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181458.986204:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a93f0191/0x76fb55528351776d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df7ffb expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789181458.986245:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789181458.986268:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1789181458.986273:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181458.986283:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a93f0191/0x76fb55528351776d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ffb expref: 8 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.986312:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a93f0191/0x76fb55528351776d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ffb expref: 8 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181458.986325:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fa00, rc 0) 00000100:00100000:3.0:1789181458.986391:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2396:x1876092385287552:12345-192.168.202.1@tcp:101:bash.0 Request processed in 241us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181458.986398:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1789181458.994236:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181458.994334:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385287680 00000100:00100000:2.0:1789181458.994344:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385287680 00000100:00100000:2.0:1789181458.994408:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1789181458.994419:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:11357:x1876092385287680:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1789181458.994437:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181458.994454:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8002 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.994487:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a93f0191/0x76fb55528351776d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ffb expref: 9 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.994496:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181458.994500:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181458.994506:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.994539:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a93f0191/0x76fb55528351776d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ffb expref: 9 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.994553:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a93f0191/0x76fb55528351776d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ffb expref: 9 pid: 8629 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181458.994587:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff907480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1876092408436736:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181458.994675:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181458.997867:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181458.997951:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385287808 00000100:00100000:1.0:1789181458.997961:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385287808 00010000:00010000:1.0:1789181458.998004:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a93f0191/0x76fb55528351776d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ffb expref: 10 pid: 8629 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181458.998047:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1789181458.998057:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2394:x1876092385287808:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181458.998072:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181458.998094:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a93f0191/0x76fb55528351776d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ffb expref: 10 pid: 8629 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.998109:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a93f0191/0x76fb55528351776d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ffb expref: 10 pid: 8629 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181458.998151:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181458.998156:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181458.998165:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.998390:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a93f0191/0x76fb55528351776d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ffb expref: 10 pid: 8629 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181458.998406:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff907480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1876092408436736:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181458.998444:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.998551:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181458.998564:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a000, rc 0) 00000100:00100000:2.0:1789181458.998624:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:11357:x1876092385287680:12345-192.168.202.1@tcp:101:bash.0 Request processed in 4207us (4395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181458.998632:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00010000:00010000:1.0:1789181459.000538:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181459.000562:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1876092408436864:192.168.202.1@tcp:105: 00000100:00100000:1.0:1789181459.000690:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789181459.005529:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.005628:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385288064 00000100:00100000:2.0:1789181459.005639:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385288064 00000100:00100000:2.0:1789181459.005704:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1789181459.005714:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:11357:x1876092385288064:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1789181459.006082:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:11357:x1876092385288064:12345-192.168.202.1@tcp:35:bash.0 Request processed in 368us (563us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789181459.006090:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:1.0:1789181459.006407:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1876092408436864:192.168.202.1@tcp:105: 00010000:00010000:1.0:1789181459.006430:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181459.006456:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385287808:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 8401us (8601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181459.006466:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1789181459.193468:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.195049:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385288192 00000100:00100000:2.0:1789181459.195065:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385288192 00000100:00100000:2.0:1789181459.195140:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:2.0:1789181459.195168:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:11373:x1876092385288192:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181459.195209:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181459.195232:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351777b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8009 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.195309:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517782 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.195325:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.195339:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181459.195403:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789181459.195407:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181459.195426:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517782 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.195451:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351777b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8009 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.195471:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517782 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8009 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.195479:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:2.0:1789181459.195481:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181459.195485:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084aa00, rc 0) 00000100:00100000:2.0:1789181459.195548:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+39:11373:x1876092385288192:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 382us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181459.195563:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 108 00000100:00100000:0.0:1789181459.202778:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181459.204843:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385288448 00000100:00100000:1.0:1789181459.204864:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385288448 00000100:00100000:1.0:1789181459.205002:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:1.0:1789181459.205015:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+39:11373:x1876092385288448:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181459.205039:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181459.205063:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517789 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8010 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.205199:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517790 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.205215:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.205227:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181459.205252:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789181459.205373:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517789 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8010 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.205391:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8010 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.205399:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd82e2e00) 00010000:00010000:1.0:1789181459.205403:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181459.205406:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12200, rc 0) 00000100:00100000:1.0:1789181459.205477:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+41:11373:x1876092385288448:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 465us (2708us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789181459.205485:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 109 00000100:00100000:0.0:1789181459.209834:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.209947:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385288704 00000100:00100000:2.0:1789181459.209959:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385288704 00000100:00100000:2.0:1789181459.210029:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1789181459.210044:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+41:2396:x1876092385288704:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181459.210060:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181459.210085:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8010 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.210105:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd82e2e00) 00010000:00010000:2.0:1789181459.210111:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181459.210408:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+40:2396:x1876092385288704:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 367us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181459.210417:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1789181459.213640:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181459.216129:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385288832 00000100:00100000:0.0:1789181459.216146:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385288832 00000100:00100000:0.0:1789181459.216224:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 110 00000100:00100000:0.0:1789181459.216236:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+40:11373:x1876092385288832:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181459.216264:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181459.216288:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb55528351779e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8017 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.216399:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb5552835177a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.216419:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb5552835177a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.216443:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb5552835177a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181459.216457:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789181459.216575:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb55528351779e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8017 expref: 43 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.216596:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb5552835177a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8017 expref: 42 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.216618:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd82e2e00) 00010000:00010000:0.0:1789181459.216621:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789181459.216625:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0000, rc 0) 00000100:00100000:0.0:1789181459.216714:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+42:11373:x1876092385288832:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 480us (3085us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789181459.218104:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 110 00000001:00080000:1.0:1789181459.218856:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1789181459.218869:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1789181459.223441:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181459.223653:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385288960 00000100:00100000:3.0:1789181459.223665:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385288960 00000100:00100000:3.0:1789181459.223751:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1789181459.223764:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385288960:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:3.0:1789181459.223827:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.223848:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.224421:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789181459.224427:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181459.224432:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.224473:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.224490:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 6 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181459.224506:0:8629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4462680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1876092408436992:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181459.226093:0:8629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27a33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181459.230140:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181459.230265:0:8629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4462680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1876092408436992:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181459.230294:0:8629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181459.230327:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385289088 00000100:00100000:2.0:1789181459.230334:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385289088 00002000:00100000:2.0:1789181459.230382:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c1cc4460380 x1876092385289088/t0(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:590/0 lens 504/0 e 0 to 0 dl 1789181470 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181459.230393:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc4460380 with x1876092385289088 ext(0->8) 00010000:00010000:2.0:1789181459.230399:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 7 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.230413:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 7 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181459.230421:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c1cc4460380 00000100:00100000:2.0:1789181459.230468:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1789181459.230477:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385289088:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:2.0:1789181459.232050:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2394:x1876092385289088:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 1564us (1912us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789181459.232061:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00002000:00100000:2.0:1789181459.232073:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c1cc4460380 x1876092385289088/t4294967303(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:590/0 lens 504/448 e 0 to 0 dl 1789181470 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181459.232082:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc4460380 with x1876092385289088 ext(0->8) 00010000:00010000:2.0:1789181459.232089:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.232105:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181459.232112:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c1cc4460380 00000100:00100000:1.0:1789181459.236443:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181459.236652:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385289216 00000100:00100000:3.0:1789181459.236663:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385289216 00010000:00010000:3.0:1789181459.236710:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181459.236802:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:3.0:1789181459.236821:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2396:x1876092385289216:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181459.236837:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789181459.236855:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789181459.236859:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789181458 00002000:00010000:3.0:1789181459.236862:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789181458 00002000:00010000:3.0:1789181459.236879:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789181458 00002000:00010000:3.0:1789181459.236881:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789181459.236890:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.236916:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.237323:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517774 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8002 expref: 9 pid: 8436 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.237345:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181459.237350:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181459.237356:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.237369:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.237418:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181459.237488:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2396:x1876092385289216:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 669us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181459.237496:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00010000:00010000:0.0:1789181459.238148:0:8629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.238164:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.238189:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.238197:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.238276:0:8629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.238284:0:8629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ea00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181459.238288:0:8629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.238297:0:8629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.238311:0:8629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.238338:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb5552835177b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181459.238408:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385288960:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 14646us (14989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181459.238417:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1789181459.245414:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.245505:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385289472 00000100:00100000:2.0:1789181459.245517:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385289472 00000100:00100000:2.0:1789181459.246082:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:2.0:1789181459.246096:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd13d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+42:11373:x1876092385289472:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:2.0:1789181459.246171:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb5552835177a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8017 expref: 42 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181459.246413:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789181459.246446:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789181459.249538:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1789181459.249625:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.249664:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ff4 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.249675:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.249720:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ff4 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.249766:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ff4 expref: 46 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181459.249781:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff907480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1876092408437120:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181459.249888:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181459.253846:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff907480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1876092408437120:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181459.253881:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181459.262918:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181459.263077:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385289600 00000100:00100000:1.0:1789181459.263088:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385289600 00010000:00010000:1.0:1789181459.263133:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ff4 expref: 47 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181459.263178:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:1.0:1789181459.263189:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+47:2393:x1876092385289600:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181459.263520:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181459.263529:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ff4 expref: 47 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.263543:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ff4 expref: 47 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.263567:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351775f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ff4 expref: 47 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.263584:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd82e2e00) 00010000:00010000:1.0:1789181459.263591:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.263622:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.263630:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.263777:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181459.263864:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+46:2393:x1876092385289600:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 676us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181459.263873:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00010000:00010000:3.0:1789181459.264196:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.264451:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181459.264585:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1789181459.265180:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1789181459.265424:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4463480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876092408437248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789181459.265489:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181459.265573:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27a3900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181459.265619:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408437248 00000100:00100000:1.0:1789181459.265627:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408437248 00000100:00100000:1.0:1789181459.266013:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789181459.266025:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1876092408437248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789181459.266411:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1876092408437248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 388us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181459.266420:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789181459.266505:0:6525:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1789181459.266512:0:6525:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1789181459.266534:0:6525:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1dff852d80, transno 4294967302 00000100:00100000:0.0:1789181459.266597:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4463480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876092408437248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789181459.266792:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1789181459.266872:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876092408437376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789181459.266926:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181459.266953:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789181459.267307:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408437376 00000100:00100000:1.0:1789181459.267315:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408437376 00000100:00100000:1.0:1789181459.267393:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789181459.267403:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1876092408437376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789181459.267533:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6525:x1876092408437376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 131us (607us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789181459.267540:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789181459.267607:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1876092408437376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789181459.267665:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1789181459.267702:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.267712:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.267721:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.267752:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181459.267757:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.267764:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.267781:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd82e2e00) 00010000:00010000:0.0:1789181459.267783:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789181459.267788:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.267793:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835177ba lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789181459.267905:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789181459.267964:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1789181459.267976:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 415255251620ns, next at 416255248932ns, rc = 0 00000001:00080000:0.0:1789181459.267982:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1789181459.268004:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd82e2e00) 00010000:00010000:0.0:1789181459.268007:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789181459.268014:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb5552835177a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8017 expref: 50 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181459.268127:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd13d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+49:11373:x1876092385289472:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 22035us (22723us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789181459.268136:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000020:00080000:0.0:1789181459.268140:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789181459.275481:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.275580:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385289728 00000100:00100000:2.0:1789181459.275591:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385289728 00000100:00100000:2.0:1789181459.275657:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:2.0:1789181459.275669:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+49:11373:x1876092385289728:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181459.275693:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181459.275717:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb5552835177c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df801e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.275821:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb5552835177c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df801e expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.275837:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb5552835177c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df801e expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.275878:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.275882:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181459.275887:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b200, rc 0) 00000100:00100000:2.0:1789181459.275945:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+50:11373:x1876092385289728:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 278us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181459.275952:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 111 00000100:00100000:3.0:1789181459.282154:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.284790:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385289984 00000100:00100000:2.0:1789181459.284817:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385289984 00000100:00100000:2.0:1789181459.284880:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1789181459.284901:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+50:11373:x1876092385289984:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1789181459.285155:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+51:11373:x1876092385289984:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 264us (3011us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789181459.285163:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1789181459.392341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.393366:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385290112 00000100:00100000:2.0:1789181459.393379:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385290112 00000100:00100000:2.0:1789181459.393442:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:2.0:1789181459.393453:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+51:11383:x1876092385290112:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:2.0:1789181459.393531:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.393550:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.393563:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.393594:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.393602:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.393609:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.393941:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.393952:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.393959:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181459.394009:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394022:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394029:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394036:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394043:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181459.394047:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394062:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394075:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:2.0:1789181459.394079:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181459.394084:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394090:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394104:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394111:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394117:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394123:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181459.394125:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394132:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394140:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dd82e2100) 00010000:00010000:2.0:1789181459.394143:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181459.394146:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394162:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394173:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394179:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394184:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394189:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181459.394192:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394197:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394205:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.394207:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181459.394210:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.394216:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181459.394567:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+51:11383:x1876092385290112:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1112us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181459.394576:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 112 00000100:00100000:3.0:1789181459.485299:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.485449:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385290368 00000100:00100000:2.0:1789181459.485461:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385290368 00000100:00100000:2.0:1789181459.485522:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:2.0:1789181459.485534:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+51:11386:x1876092385290368:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181459.485558:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181459.485581:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8025 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.485678:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.485695:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.485706:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.485718:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.485772:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.485779:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.485901:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835177f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.485911:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835177f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.485938:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835177f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181459.485948:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789181459.486027:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486035:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177e4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486041:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486047:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181459.486051:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486059:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177e4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486072:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:2.0:1789181459.486075:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181459.486080:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486085:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb5552835177e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486098:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486103:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486115:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486120:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181459.486123:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486129:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486138:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dd82e2100) 00010000:00010000:2.0:1789181459.486140:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181459.486143:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486148:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb5552835177eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486182:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835177dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8025 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486196:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835177f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8025 expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.486204:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.486206:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181459.486209:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b000, rc 0) 00000100:00100000:2.0:1789181459.486276:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+53:11386:x1876092385290368:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 744us (987us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789181459.486294:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 113 00000100:00100000:3.0:1789181459.491997:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181459.492148:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385290496 00000100:00100000:0.0:1789181459.492159:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385290496 00000100:00100000:0.0:1789181459.492229:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:0.0:1789181459.492241:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+53:11386:x1876092385290496:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1789181459.492310:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.492328:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.492341:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.492376:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.492384:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517800 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.492392:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.492397:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1e00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181459.492402:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.492409:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.492421:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:0.0:1789181459.492440:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181459.492446:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517800 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.492452:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181459.492548:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+53:11386:x1876092385290496:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 309us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181459.492556:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 114 00000100:00100000:1.0:1789181459.497201:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.497303:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385290752 00000100:00100000:2.0:1789181459.497314:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385290752 00000100:00100000:2.0:1789181459.497367:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1789181459.497378:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+53:11386:x1876092385290752:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1789181459.497648:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:11386:x1876092385290752:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 270us (456us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789181459.497656:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1789181459.616918:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181459.617101:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385291008 00000100:00100000:1.0:1789181459.617113:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385291008 00000100:00100000:1.0:1789181459.617197:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:1.0:1789181459.617209:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:11396:x1876092385291008:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181459.617237:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181459.617241:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789181459.617271:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517782 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8009 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.617292:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:1.0:1789181459.617297:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181459.617311:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517807 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df802c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.617418:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351780e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.617434:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351780e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.617444:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351780e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181459.617456:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789181459.617586:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517807 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df802c expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.617604:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351780e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df802c expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.617612:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:1.0:1789181459.617621:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181459.617624:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13c00, rc 0) 00000100:00100000:1.0:1789181459.617694:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+55:11396:x1876092385291008:12345-192.168.202.1@tcp:101:bash.0 Request processed in 486us (788us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789181459.617701:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 115 00000100:00100000:3.0:1789181459.623868:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181459.623913:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.624228:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385291136 00000100:00100000:2.0:1789181459.624241:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385291136 00000100:00100000:2.0:1789181459.624311:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:2.0:1789181459.624322:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+55:11396:x1876092385291136:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1789181459.624347:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181459.624368:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351781c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8033 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.624407:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.624422:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.624434:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.624575:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351781c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8033 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.624609:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8033 expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.624618:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.624621:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789181459.624625:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b600, rc 0) 00000100:00100000:2.0:1789181459.624691:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+56:11396:x1876092385291136:12345-192.168.202.1@tcp:101:bash.0 Request processed in 370us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181459.624698:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 116 00000100:00100000:0.0:1789181459.626254:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385291264 00000100:00100000:0.0:1789181459.626267:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385291264 00000100:00100000:0.0:1789181459.626331:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1789181459.626342:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+56:2393:x1876092385291264:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181459.626357:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181459.626379:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351780e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df802c expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.626397:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:0.0:1789181459.626401:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181459.626454:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+55:2393:x1876092385291264:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 114us (2539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181459.626471:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1789181459.633422:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.634080:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385291520 00000100:00100000:2.0:1789181459.634093:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385291520 00000100:00100000:2.0:1789181459.634194:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:2.0:1789181459.634206:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+55:11396:x1876092385291520:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:2.0:1789181459.634261:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181459.634289:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835177f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8025 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.634308:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.634313:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181459.634475:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.634501:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.634513:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181459.634592:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1789181459.634618:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b828ea10 reply state 00000000533d6aed transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.634631:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.634638:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.634641:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789181459.634644:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181459.634857:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:11396:x1876092385291520:12345-192.168.202.1@tcp:36:bash.0 Request processed in 563us (1357us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789181459.634865:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000020:00080000:2.0:1789181459.634870:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789181459.638669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.639082:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385291648 00000100:00100000:2.0:1789181459.639095:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385291648 00000100:00100000:2.0:1789181459.639156:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:2.0:1789181459.639168:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:11396:x1876092385291648:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1789181459.639196:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181459.639218:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517831 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df803a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.639312:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.639330:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.639343:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181459.639389:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789181459.639393:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181459.639413:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.639440:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517831 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df803a expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.639457:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df803a expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.639465:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.639468:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181459.639472:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b800, rc 0) 00000100:00100000:2.0:1789181459.639899:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:11396:x1876092385291648:12345-192.168.202.1@tcp:101:bash.0 Request processed in 732us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181459.639908:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:3.0:1789181459.646536:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.646699:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385291904 00000100:00100000:2.0:1789181459.646711:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385291904 00000100:00100000:2.0:1789181459.646789:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1789181459.646882:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:11396:x1876092385291904:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1789181459.647135:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:11396:x1876092385291904:12345-192.168.202.1@tcp:35:bash.0 Request processed in 335us (608us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789181459.647143:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1789181459.724159:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408437504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181459.724236:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181459.724509:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408437504 00000100:00100000:1.0:1789181459.724519:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408437504 00000100:00100000:0.0:1789181459.724869:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789181459.724883:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408437504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181459.724918:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789181459.724992:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408437504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181459.725011:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789181459.725178:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408437504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181459.745791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181459.746121:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385292032 00000100:00100000:0.0:1789181459.746134:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385292032 00000100:00100000:0.0:1789181459.746252:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:0.0:1789181459.746264:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:11402:x1876092385292032:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181459.746290:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181459.746315:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb55528351783f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8041 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.746384:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517846 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.746399:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.746409:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181459.746526:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789181459.746530:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181459.746549:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.746586:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb55528351783f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8041 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.746605:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517846 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8041 expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181459.746631:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181459.746633:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181459.746636:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0400, rc 0) 00000100:00100000:0.0:1789181459.746690:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:11402:x1876092385292032:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 430us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181459.746695:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:3.0:1789181459.750330:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181459.750481:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385292160 00000100:00100000:1.0:1789181459.750492:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385292160 00000100:00100000:1.0:1789181459.750560:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:1.0:1789181459.750579:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:11402:x1876092385292160:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181459.750604:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181459.750627:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351784d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8048 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.750692:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517854 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.750709:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517854 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.750718:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517854 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.750880:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351785b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.750889:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351785b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.750897:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351785b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751001:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751010:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751014:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181459.751065:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789181459.751069:0:9021:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181459.751086:0:9021:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751096:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751102:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517854 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751106:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517854 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751110:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517854 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751114:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181459.751117:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517854 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751122:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517854 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751137:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:1.0:1789181459.751139:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181459.751143:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517854 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751147:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517854 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751157:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351785b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751160:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351785b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751163:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351785b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751167:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181459.751168:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351785b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751172:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351785b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751175:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dd82e2100) 00010000:00010000:1.0:1789181459.751176:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181459.751178:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351785b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751181:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351785b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751208:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb55528351784d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8048 expref: 62 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751217:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8048 expref: 61 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.751222:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:1.0:1789181459.751223:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181459.751225:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12400, rc 0) 00000100:00100000:1.0:1789181459.751281:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11402:x1876092385292160:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 703us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181459.751297:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:3.0:1789181459.754406:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181459.754447:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.754515:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385292416 00000100:00100000:2.0:1789181459.754526:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385292416 00000100:00100000:2.0:1789181459.754599:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:2.0:1789181459.754611:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11402:x1876092385292416:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181459.754633:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181459.754655:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517869 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df804f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.754774:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.754787:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df803a expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.754793:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8048 expref: 62 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.754810:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.754852:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8048 expref: 62 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.754866:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8048 expref: 62 pid: 9021 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181459.754880:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff905880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408437632:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181459.754914:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385292544 00000100:00100000:1.0:1789181459.754919:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385292544 00010000:00010000:1.0:1789181459.754941:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8048 expref: 63 pid: 9021 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181459.754968:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:1.0:1789181459.754975:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:2394:x1876092385292544:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181459.754989:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181459.754996:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8048 expref: 63 pid: 9021 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.755006:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8048 expref: 63 pid: 9021 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.755051:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:1.0:1789181459.755055:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.755061:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181459.755068:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181459.755328:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:2394:x1876092385292544:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 351us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181459.755336:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00010000:00010000:2.0:1789181459.755343:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df803a expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.755353:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df803a expref: 62 pid: 6521 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181459.755363:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff906a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408437760:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181459.755392:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789181459.758864:0:6522:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.1@tcp) returned -22 from blocking AST (req@000000002c445530 x1876092408437632) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8048 expref: 62 pid: 9021 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.758891:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517862 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8048 expref: 62 pid: 9021 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181459.758908:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff905880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408437632:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181459.759035:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.759038:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff906a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408437760:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181459.759076:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.759082:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.759092:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.759103:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181459.759128:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385292672 00000100:00100000:3.0:1789181459.759136:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385292672 00010000:00010000:3.0:1789181459.759168:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df803a expref: 62 pid: 6521 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181459.759199:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:3.0:1789181459.759209:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:2394:x1876092385292672:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181459.759225:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181459.759242:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df803a expref: 62 pid: 6521 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.759250:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df803a expref: 62 pid: 6521 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.759265:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df803a expref: 62 pid: 6521 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.759272:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:3.0:1789181459.759275:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.759290:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.759296:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181459.759313:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181459.759330:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.759343:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181459.759363:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00100000:3.0:1789181459.759369:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:2394:x1876092385292672:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 161us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181459.759376:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00010000:00010000:2.0:1789181459.760910:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517869 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df804f expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.761006:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df804f expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.761017:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.761020:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181459.761023:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084ac00, rc 0) 00000100:00100000:2.0:1789181459.761083:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11402:x1876092385292416:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 6475us (6687us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789181459.761092:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:0.0:1789181459.770584:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.770684:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385292928 00000100:00100000:2.0:1789181459.770695:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385292928 00000100:00100000:2.0:1789181459.771015:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:2.0:1789181459.771030:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11402:x1876092385292928:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:2.0:1789181459.771051:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181459.771084:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb5552835177c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df801e expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.771109:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.771115:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181459.771245:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:11402:x1876092385292928:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 218us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181459.771254:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1789181459.774365:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.774674:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385293056 00000100:00100000:2.0:1789181459.774684:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385293056 00000100:00100000:2.0:1789181459.774796:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:2.0:1789181459.774820:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:11402:x1876092385293056:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:2.0:1789181459.774995:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.775019:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.775033:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181459.775150:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789181459.775228:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:11402:x1876092385293056:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 411us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181459.775236:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:0.0:1789181459.779889:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181459.780079:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385293184 00000100:00100000:2.0:1789181459.780091:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385293184 00000100:00100000:2.0:1789181459.780159:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:2.0:1789181459.780169:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:11402:x1876092385293184:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181459.780191:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181459.780213:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517885 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8056 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.780270:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.780296:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517885 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8056 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.780315:0:6523:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.780329:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517885 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8056 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.780344:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181459.780348:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181459.780351:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517885 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8056 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181459.780359:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b200, rc 0) 00000100:00100000:2.0:1789181459.780433:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11402:x1876092385293184:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 265us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181459.780440:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00010000:00010000:2.0:1789181459.980099:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181460.236675:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408437888:0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.236787:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181460.236855:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408438400:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.236865:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408438144:0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.236894:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181460.236903:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408437888 00000100:00100000:0.0:1789181460.236910:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408437888 00000100:00100000:3.0:1789181460.236917:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408438912:0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.236947:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181460.236956:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789181460.236965:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408439424:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.236981:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408437888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.236983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181460.237003:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789181460.237008:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408438016:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.237027:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408437888:12345-0@lo:400:kworker.0 Request processed in 63us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.237029:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181460.237034:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789181460.237042:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408438528:0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.237061:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181460.237077:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408439040:0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.237094:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181460.237121:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408437888:0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.237147:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408438912 00000100:00100000:3.0:1789181460.237151:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408438912 00000100:00100000:3.0:1789181460.237187:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408439424 00000100:00100000:3.0:1789181460.237190:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408439424 00000100:00100000:3.0:1789181460.237211:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789181460.237217:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408438912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.237254:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408438912:12345-0@lo:400:kworker.0 Request processed in 38us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.237260:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789181460.237274:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789181460.237280:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408439424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.237306:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408439424:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.237312:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1789181460.237335:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181460.237339:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181460.237364:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408438912:0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.237373:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408439424:0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.237414:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181460.237434:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408438656:0@lo:400:kworker.0 00000100:00100000:3.0:1789181460.237457:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181460.237473:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408439168:0@lo:400:kworker.0 00000004:00080000:1.0:1789181460.238683:0:9990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416225956527ns, next at 417225953314ns, rc = 0 00000100:00100000:2.0:1789181460.238762:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408439552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181460.238834:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408438400 00000100:00100000:1.0:1789181460.238840:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408438400 00000100:00100000:1.0:1789181460.238882:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408438144 00000100:00100000:1.0:1789181460.238886:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408438144 00000100:00100000:1.0:1789181460.238902:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789181460.238911:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408438400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.248834:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789181460.248855:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408438144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.248950:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408438144:12345-0@lo:400:kworker.0 Request processed in 104us (11535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181460.248958:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789181460.249035:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408438016 00000100:00100000:0.0:1789181460.249052:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408438016 00000100:00100000:0.0:1789181460.249236:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408438528 00000100:00100000:0.0:1789181460.249241:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408438528 00000100:00100000:0.0:1789181460.249277:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408439040 00000100:00100000:0.0:1789181460.249279:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408439040 00000100:00100000:0.0:1789181460.249499:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408438656 00000100:00100000:0.0:1789181460.249503:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408438656 00000100:00100000:0.0:1789181460.249522:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789181460.249529:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408438016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.249570:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408438016:12345-0@lo:400:kworker.0 Request processed in 42us (12540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181460.249576:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789181460.249588:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789181460.249593:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408438528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.249613:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408438528:12345-0@lo:400:kworker.0 Request processed in 21us (12552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181460.249619:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789181460.249628:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789181460.249632:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408439040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.249651:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408439040:12345-0@lo:400:kworker.0 Request processed in 19us (12556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181460.249656:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789181460.249664:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789181460.249669:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408438656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.249689:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408438656:12345-0@lo:400:kworker.0 Request processed in 20us (12231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181460.249694:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789181460.249765:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408438016:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.249785:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408438528:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.249806:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408439040:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.249897:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408438272:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.249932:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181460.249956:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408438784:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.256036:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181460.257072:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408438272 00000100:00100000:2.0:1789181460.257086:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408438272 00000100:00100000:2.0:1789181460.257154:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789181460.257165:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408438272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.257582:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408439296:0@lo:400:kworker.0 00000100:00100000:2.0:1789181460.274357:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408438272:12345-0@lo:400:kworker.0 Request processed in 17184us (24414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.274404:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789181460.274515:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181460.274561:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408439552 00000100:00100000:2.0:1789181460.274569:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408439552 00000100:00100000:2.0:1789181460.274612:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789181460.274619:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408439552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181460.274649:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181460.274686:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408439552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.274691:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789181460.274762:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408439552:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789181460.274818:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181460.274824:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181460.274842:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408438784 00000100:00100000:2.0:1789181460.274846:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408438784 00000100:00100000:2.0:1789181460.274878:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789181460.274884:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408438784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181460.274919:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408438784:12345-0@lo:400:kworker.0 Request processed in 36us (18895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.274924:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1789181460.274938:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181460.275250:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408438400:12345-0@lo:400:kworker.0 Request processed in 36337us (38352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181460.275260:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789181460.279461:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408438400:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.282009:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181460.282091:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408438272:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.282105:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408438784:0@lo:400:kworker.0 00000100:00100000:0.0:1789181460.282120:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181460.282129:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408439680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181460.282164:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181460.282525:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408439296 00000100:00100000:1.0:1789181460.282532:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408439296 00000100:00100000:1.0:1789181460.282598:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789181460.282607:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408439296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181460.282666:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408439296:12345-0@lo:400:kworker.0 Request processed in 60us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181460.282689:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789181460.282743:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408439296:0@lo:400:kworker.0 00000100:00080000:0.0:1789181460.283374:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181460.285150:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408439680 00000100:00100000:2.0:1789181460.285164:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408439680 00000100:00100000:2.0:1789181460.285235:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789181460.285246:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408439680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789181460.285291:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181460.285428:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408439680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181460.285847:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408439680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.285856:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789181460.287077:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181460.287160:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408438144:0@lo:400:kworker.0 00010000:00080000:3.0:1789181460.287178:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4dead80 x1876092408438656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181460.287188:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408438656:0@lo:400:kworker.0 00000100:00100000:2.0:1789181460.287946:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408439168 00000100:00100000:2.0:1789181460.287955:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408439168 00000100:00100000:2.0:1789181460.288040:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789181460.288050:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408439168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181460.288144:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408439168:12345-0@lo:400:kworker.0 Request processed in 95us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.288152:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:0.0:1789181460.288232:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789181460.288349:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4de9c00 x1876092408439168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181460.288361:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408439168:0@lo:400:kworker.0 00000040:00080000:0.0:1789181460.491995:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181460.492006:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181460.492042:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789181460.492054:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181460.492196:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408439808:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789181460.492327:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41600 going to sleep for 11 seconds 00000100:00100000:3.0:1789181460.504024:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181460.504145:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408439808:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789181460.504359:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385293312 00000100:00100000:2.0:1789181460.504366:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385293312 00000100:00100000:2.0:1789181460.504455:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:2.0:1789181460.504465:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11403:x1876092385293312:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789181460.504511:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789181460.504954:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11403:x1876092385293312:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 489us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.504963:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00080000:0.0:1789181460.505586:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181460.520620:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181460.520700:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385293440 00000100:00100000:0.0:1789181460.520711:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385293440 00000100:00100000:0.0:1789181460.520836:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:0.0:1789181460.520847:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11403:x1876092385293440:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789181460.520926:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351788c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.520944:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351788c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.520958:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351788c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.520974:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517893 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.520981:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517893 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.520988:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517893 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521009:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521019:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521026:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181460.521093:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789181460.521098:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181460.521111:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521122:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351788c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521129:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351788c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521135:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351788c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521142:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181460.521146:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351788c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521154:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351788c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521176:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:0.0:1789181460.521179:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181460.521185:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351788c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521191:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb55528351788c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521204:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517893 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521220:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517893 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521226:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517893 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521231:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0e00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181460.521234:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517893 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521240:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517893 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521248:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9c1dd82e2e00) 00010000:00010000:0.0:1789181460.521251:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181460.521253:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517893 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521259:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517893 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521273:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521279:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521284:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521288:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181460.521297:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521303:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521311:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:0.0:1789181460.521313:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181460.521315:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.521321:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb55528351789a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.521398:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11403:x1876092385293440:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 551us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181460.521406:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:1.0:1789181460.525381:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181460.525476:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385293696 00000100:00100000:2.0:1789181460.525488:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385293696 00000100:00100000:2.0:1789181460.525566:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:2.0:1789181460.525577:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:11403:x1876092385293696:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181460.525599:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181460.525618:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835178a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df805d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.525782:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.525810:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.525823:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181460.525836:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789181460.525918:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.525926:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.525933:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.525940:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181460.525945:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.525953:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.525967:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181460.525970:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789181460.525975:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.525993:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.526037:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835178a1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df805d expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.526048:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:2.0:1789181460.526051:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181460.526055:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835178a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df805d expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.526064:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a600, rc 0) 00000100:00100000:2.0:1789181460.526129:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:11403:x1876092385293696:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 553us (757us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1789181460.526137:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:1.0:1789181460.541598:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181460.541701:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385293824 00000100:00100000:0.0:1789181460.541713:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385293824 00000100:00100000:0.0:1789181460.541836:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:0.0:1789181460.541849:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:11403:x1876092385293824:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789181460.541889:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789181460.542006:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:11403:x1876092385293824:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 159us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181460.542014:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:0.0:1789181460.548037:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181460.548185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385294080 00000100:00100000:2.0:1789181460.548195:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385294080 00000100:00100000:2.0:1789181460.548255:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:2.0:1789181460.548266:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:11403:x1876092385294080:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181460.548287:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181460.548291:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789181460.548317:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517846 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8041 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.548336:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:2.0:1789181460.548341:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181460.548370:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835178b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8064 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789181460.549015:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789181460.549168:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.549183:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.549192:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.549244:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb5552835178b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8064 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.549259:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8064 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.549266:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dd8258d00) 00010000:00010000:2.0:1789181460.549269:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181460.549272:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a200, rc 0) 00000100:00100000:2.0:1789181460.549336:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:11403:x1876092385294080:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1072us (1308us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789181460.549343:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:1.0:1789181460.570078:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181460.570313:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385294336 00000100:00100000:0.0:1789181460.570324:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385294336 00000100:00100000:0.0:1789181460.570385:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:0.0:1789181460.570395:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:11403:x1876092385294336:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789181460.570483:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181460.570512:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb5552835178bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8064 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570531:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dd8258d00) 00010000:00010000:0.0:1789181460.570542:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181460.570563:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb5552835178cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570577:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb5552835178cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570586:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb5552835178cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570601:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb5552835178d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x5638d0b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570608:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb5552835178d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5638d0b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570615:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb5552835178d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5638d0b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570662:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb5552835178cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570670:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb5552835178cb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570676:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb5552835178cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570689:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181460.570693:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb5552835178cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570700:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb5552835178cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570710:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:0.0:1789181460.570712:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181460.570716:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb5552835178cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570970:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb5552835178cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570983:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb5552835178d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5638d0b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570989:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb5552835178d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5638d0b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.570994:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb5552835178d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5638d0b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.571000:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0e00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181460.571003:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb5552835178d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5638d0b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.571009:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb5552835178d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5638d0b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.571030:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x5638d0b3 (ffff9c1dd82e2e00) 00010000:00010000:0.0:1789181460.571033:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181460.571036:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb5552835178d2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x5638d0b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.571042:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb5552835178d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x5638d0b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.571134:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:11403:x1876092385294336:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 739us (1065us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789181460.571142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:1.0:1789181460.575414:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.575622:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385294464 00000100:00100000:3.0:1789181460.575632:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385294464 00000100:00100000:3.0:1789181460.575692:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:3.0:1789181460.575704:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:11403:x1876092385294464:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181460.576099:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.576124:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835178d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df806b expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.576160:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.576174:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.576201:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.576309:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835178d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df806b expref: 64 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.576326:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df806b expref: 63 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.576335:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181460.576338:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789181460.576342:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085ee00, rc 0) 00000100:00100000:3.0:1789181460.576447:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:11403:x1876092385294464:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 744us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.576454:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:2.0:1789181460.580160:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.587193:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385294720 00000100:00100000:3.0:1789181460.587210:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385294720 00000100:00100000:3.0:1789181460.587288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:3.0:1789181460.587300:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:11403:x1876092385294720:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789181460.587388:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.587406:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.587417:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181460.587615:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1789181460.587670:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcfceccc reply state 0000000074de6950 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.587682:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.587691:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181460.587693:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789181460.587697:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181460.587849:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:11403:x1876092385294720:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 550us (7698us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789181460.587857:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:1.0:1789181460.591038:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181460.591475:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385294848 00000100:00100000:2.0:1789181460.591485:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385294848 00000100:00100000:2.0:1789181460.591544:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:2.0:1789181460.591554:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:11403:x1876092385294848:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181460.591803:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181460.591826:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb5552835178ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8072 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.591887:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb5552835178ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8072 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.591903:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb5552835178ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8072 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.591924:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:2.0:1789181460.591928:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181460.591932:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084bc00, rc 0) 00000100:00100000:2.0:1789181460.591992:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:11403:x1876092385294848:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 439us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.591999:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:2.0:1789181460.597133:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.598624:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385294976 00000100:00100000:3.0:1789181460.598637:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385294976 00000100:00100000:3.0:1789181460.598712:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00080000:0.0:1789181460.598910:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181460.598993:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385294976:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789181460.599437:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385294976:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 714us (2311us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789181460.599445:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1789181460.610063:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.610711:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385295232 00000100:00100000:3.0:1789181460.610771:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385295232 00000100:00100000:3.0:1789181460.610848:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1789181460.610859:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:11403:x1876092385295232:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789181460.611112:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:11403:x1876092385295232:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 254us (1059us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789181460.611136:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1789181460.619341:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.619438:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385295488 00000100:00100000:3.0:1789181460.619448:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385295488 00000100:00100000:3.0:1789181460.619523:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:3.0:1789181460.619535:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:11403:x1876092385295488:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789181460.619667:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:11403:x1876092385295488:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 134us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.619674:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:1.0:1789181460.625229:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.625356:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385295616 00000100:00100000:3.0:1789181460.625366:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385295616 00000100:00100000:3.0:1789181460.625422:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:3.0:1789181460.625432:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:11403:x1876092385295616:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181460.625455:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.625477:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835178f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8079 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.625545:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835178fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.625571:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835178fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.625584:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835178fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181460.625630:0:9021:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181460.625647:0:9021:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835178fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.625685:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb5552835178f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8079 expref: 69 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.625703:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835178fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8079 expref: 68 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.625713:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181460.626004:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789181460.626009:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fe00, rc 0) 00000100:00100000:3.0:1789181460.626077:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:11403:x1876092385295616:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 645us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.626084:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:2.0:1789181460.630525:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181460.631089:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385295744 00000100:00100000:1.0:1789181460.631101:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385295744 00000100:00100000:1.0:1789181460.631151:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1789181460.631173:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385295744:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181460.631191:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181460.631213:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b856d1ba/0x76fb555283517903 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8080 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181460.631239:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4be14, blocks: 0x0 00010000:00010000:1.0:1789181460.631262:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1789181460.631267:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181460.631277:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b856d1ba/0x76fb555283517903 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8080 expref: 10 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.631317:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b856d1ba/0x76fb555283517903 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8080 expref: 10 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.631331:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12800, rc 0) 00000100:00100000:1.0:1789181460.631399:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2393:x1876092385295744:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 239us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181460.631406:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1789181460.638244:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.638382:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385296000 00000100:00100000:3.0:1789181460.638393:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385296000 00000100:00100000:3.0:1789181460.638460:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:3.0:1789181460.638471:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:11403:x1876092385296000:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789181460.638605:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:11403:x1876092385296000:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 136us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.638614:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1789181460.658838:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.658984:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385296128 00000100:00100000:3.0:1789181460.658996:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385296128 00000100:00100000:3.0:1789181460.659061:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1789181460.659073:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:11403:x1876092385296128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181460.659093:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.659113:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8087 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.659185:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b856d1ba/0x76fb555283517903 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8080 expref: 11 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.659194:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181460.659199:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181460.659204:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.659241:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b856d1ba/0x76fb555283517903 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8080 expref: 11 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.659257:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b856d1ba/0x76fb555283517903 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8080 expref: 11 pid: 8629 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181460.659273:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4dec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1876092408439936:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181460.659374:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27a3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181460.664231:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4dec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1876092408439936:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181460.664269:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.664292:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e200, rc 0) 00000100:00100000:3.0:1789181460.664355:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:11403:x1876092385296128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 5284us (5528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.664364:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1789181460.667389:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181460.667487:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385296256 00000100:00100000:2.0:1789181460.667498:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385296256 00010000:00010000:2.0:1789181460.667543:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b856d1ba/0x76fb555283517903 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8080 expref: 11 pid: 8629 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.667599:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:2.0:1789181460.667609:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:2393:x1876092385296256:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181460.667627:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181460.667667:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b856d1ba/0x76fb555283517903 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8080 expref: 11 pid: 8629 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.667680:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b856d1ba/0x76fb555283517903 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8080 expref: 11 pid: 8629 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.667704:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b856d1ba/0x76fb555283517903 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8080 expref: 11 pid: 8629 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.667842:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181460.667848:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181460.667858:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.667869:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.667911:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.667938:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff904a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1876092408440064:192.168.202.1@tcp:105: 00000100:00100000:2.0:1789181460.668038:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181460.675544:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff904a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1876092408440064:192.168.202.1@tcp:105: 00010000:00010000:3.0:1789181460.675603:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181460.675677:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2393:x1876092385296256:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 8069us (8298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.675689:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:2.0:1789181460.676510:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.677333:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385296384 00000100:00100000:3.0:1789181460.677345:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385296384 00002000:00100000:3.0:1789181460.677398:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c1dff904380 x1876092385296384/t0(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:591/0 lens 504/0 e 0 to 0 dl 1789181471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181460.677408:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dff904380 with x1876092385296384 ext(0->12) 00002000:00010000:3.0:1789181460.677413:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1dff904380 00000100:00100000:3.0:1789181460.677445:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1789181460.677455:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2393:x1876092385296384:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789181460.679420:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:2393:x1876092385296384:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 1958us (2906us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789181460.679432:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:3.0:1789181460.679445:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c1dff904380 x1876092385296384/t4294967309(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:591/0 lens 504/448 e 0 to 0 dl 1789181471 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181460.679455:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dff904380 with x1876092385296384 ext(0->12) 00002000:00010000:3.0:1789181460.679460:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1dff904380 00000100:00100000:2.0:1789181460.687653:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.687784:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385296512 00000100:00100000:3.0:1789181460.687806:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385296512 00000100:00100000:3.0:1789181460.687867:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:3.0:1789181460.687879:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:11403:x1876092385296512:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789181460.693126:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1789181460.693148:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1789181460.693233:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:3.0:1789181460.693580:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693607:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693615:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693622:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181460.693627:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693635:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693651:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c1dc6843800) 00010000:00010000:3.0:1789181460.693654:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.693659:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693666:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678200/0x76fb55528351760f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693693:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693697:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693701:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693704:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181460.693711:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693716:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693763:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c1dd82e2200) 00010000:00010000:3.0:1789181460.693766:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.693769:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693776:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb5552835176b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693804:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693811:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693818:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693823:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181460.693827:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693833:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693841:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dd82e2100) 00010000:00010000:3.0:1789181460.693843:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.693854:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693860:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517735 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693872:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693879:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693885:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693890:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181460.693893:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693899:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693907:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dd82e2100) 00010000:00010000:3.0:1789181460.693910:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.693924:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693930:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517758 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693945:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693961:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693966:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693970:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181460.693972:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693978:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693986:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:3.0:1789181460.693988:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.693991:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.693996:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351782a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.694009:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.694015:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.694020:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.694025:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181460.694034:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.694041:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.694050:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181460.694053:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789181460.694056:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.694061:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835178e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.694810:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408440320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789181460.694879:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181460.694999:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408440320 00000100:00100000:3.0:1789181460.695018:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408440320 00000100:00100000:3.0:1789181460.695069:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789181460.695079:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408440320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789181460.695108:0:8629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1789181460.695144:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4be12, atime: 0x6aa4be12, ctime: 0x6aa4be12, blocks: 0x8 00010000:00010000:3.0:1789181460.695151:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb555283517911 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.695176:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1789181460.695181:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181460.695189:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb555283517911 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.695204:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb555283517911 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.695226:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb555283517911 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.695235:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb555283517911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.695254:0:8629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789181460.695721:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408440192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789181460.695779:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181460.695821:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408440192 00000100:00100000:0.0:1789181460.695827:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408440192 00000100:00100000:0.0:1789181460.695856:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789181460.695863:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408440192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789181460.695878:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1789181460.695895:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.695924:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c853ff7/0x76fb5552835176c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fdf expref: 11 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.695945:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789181460.695949:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181460.695953:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.695988:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c853ff7/0x76fb5552835176c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fdf expref: 11 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.696003:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c853ff7/0x76fb5552835176c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fdf expref: 11 pid: 8629 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.696028:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408440448:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181460.696091:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41600 going to sleep for 11 seconds 00000020:00080000:1.0:1789181460.697214:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c1dfb2d66c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789181460.697223:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1de7daa300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c1dfb2d6480 00000020:00080000:1.0:1789181460.697227:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1e00912d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c1dd81e8a00 00000004:00080000:1.0:1789181460.697256:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789181460.697289:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c1dd00c10c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789181460.697293:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1df3de9400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c1dd00c1480 00000020:00080000:1.0:1789181460.697296:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1df3de9a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c1df9cec800 00000020:00080000:0.0:1789181460.700042:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789181460.700133:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789181460.701447:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3643:x1876092408440320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6360us (6559us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789181460.701472:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1789181460.701510:0:13192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181460.701519:0:13192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb555283517911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.701533:0:13192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ea00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181460.701538:0:13192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb555283517911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.701560:0:13192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb555283517911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.701587:0:13192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb555283517911 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.701596:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024ace32a/0x76fb555283517911 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.701637:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181460.701639:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181460.701641:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181460.701873:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:11403:x1876092385296512:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 13994us (14230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.701882:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000004:00080000:2.0:1789181460.702153:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1cc4470000/2, rc 0, transno 4294967305 00000100:00100000:2.0:1789181460.702172:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408440320:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789181460.702438:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.704528:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385296640 00000100:00100000:3.0:1789181460.704545:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385296640 00010000:00010000:3.0:1789181460.704606:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c853ff7/0x76fb5552835176c5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fdf expref: 12 pid: 8629 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181460.704720:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:3.0:1789181460.704749:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:2394:x1876092385296640:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181460.704766:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181460.704772:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c853ff7/0x76fb5552835176c5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fdf expref: 12 pid: 8629 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.704787:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c853ff7/0x76fb5552835176c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fdf expref: 12 pid: 8629 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.704828:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181460.704833:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181460.704839:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.704872:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.704894:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181460.704959:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:2394:x1876092385296640:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 211us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.704967:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:3.0:1789181460.705073:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.705100:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385296768 00000100:00100000:3.0:1789181460.705104:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385296768 00000100:00100000:3.0:1789181460.705130:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1789181460.705137:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:2394:x1876092385296768:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1789181460.707765:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c853ff7/0x76fb5552835176c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fdf expref: 12 pid: 8629 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.707804:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408440448:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181460.707834:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.707847:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.707854:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.707868:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.707875:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.707898:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789181460.708598:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181460.708607:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.708617:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181460.708622:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.708632:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.708668:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.708676:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb555283517918 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.708697:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181460.708699:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181460.708701:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789181460.708767:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1dff906680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789181460.708780:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408440192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789181460.708873:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1876092408440192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13008us (13092us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789181460.708884:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000001:00080000:2.0:1789181460.709501:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1789181460.709526:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1789181460.710370:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385296768:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 5227us (5290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181460.710381:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1789181460.713443:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.713631:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385297024 00000100:00100000:3.0:1789181460.713642:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385297024 00000100:00100000:3.0:1789181460.713768:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:3.0:1789181460.713779:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:11403:x1876092385297024:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789181460.713851:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181460.713879:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835178fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8079 expref: 16 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.713898:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181460.713903:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181460.714032:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.714048:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.714073:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181460.714208:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea3e9dee reply state 000000008b88d1bd transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.714220:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.714227:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181460.714230:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181460.714233:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181460.714334:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:11403:x1876092385297024:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 557us (899us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1789181460.714342:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:2.0:1789181460.717691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.718119:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385297152 00000100:00100000:3.0:1789181460.718129:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385297152 00000100:00100000:3.0:1789181460.718289:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1789181460.718299:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385297152:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789181460.718452:0:8629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789181460.718456:0:8629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789181459 00002000:00010000:3.0:1789181460.718459:0:8629:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789181458 00002000:00010000:3.0:1789181460.718461:0:8629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789181460 -> 1789181459 00002000:00010000:3.0:1789181460.718463:0:8629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789181460.718546:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385297152:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 248us (862us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789181460.718562:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1789181460.723099:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181460.723251:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385297408 00000100:00100000:2.0:1789181460.723262:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385297408 00000100:00100000:2.0:1789181460.723358:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:2.0:1789181460.723371:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:11403:x1876092385297408:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789181460.723444:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.723463:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df806b expref: 17 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.723473:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.723521:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df806b expref: 17 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.723536:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df806b expref: 17 pid: 9021 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.723562:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408440576:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181460.723641:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181460.728657:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181460.729523:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408440576:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181460.729562:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181460.730244:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385297536 00000100:00100000:3.0:1789181460.730255:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385297536 00010000:00010000:3.0:1789181460.730299:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df806b expref: 18 pid: 9021 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181460.730389:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1789181460.730400:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:2394:x1876092385297536:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181460.730416:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181460.730423:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df806b expref: 18 pid: 9021 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.730436:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df806b expref: 18 pid: 9021 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.730459:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb5552835178e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df806b expref: 18 pid: 9021 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.730494:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181460.730499:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.730509:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.730517:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.730548:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181460.730619:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:2394:x1876092385297536:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 220us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.730640:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00010000:00010000:0.0:1789181460.730697:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.730706:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.730780:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.730788:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.730818:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.730824:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084be00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181460.730827:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.730835:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.730844:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:0.0:1789181460.730848:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789181460.730851:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.730858:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517926 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.730902:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:11403:x1876092385297408:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 7534us (7814us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789181460.730911:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:0.0:1789181460.735681:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181460.736128:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385297664 00000100:00100000:2.0:1789181460.736152:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385297664 00000100:00100000:2.0:1789181460.736308:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1789181460.736320:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385297664:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789181460.736367:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.736388:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.736398:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181460.736403:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181460.736407:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.736443:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.736459:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 7 pid: 8435 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.736474:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408440704:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181460.736578:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181460.741585:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181460.741705:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385297792 00000100:00100000:1.0:1789181460.741714:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385297792 00010000:00010000:1.0:1789181460.741789:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 8 pid: 8435 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181460.741854:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1789181460.741864:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385297792:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181460.741881:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181460.741904:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 8 pid: 8435 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.742144:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 8 pid: 8435 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.742183:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181460.742188:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181460.742195:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.742205:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.742227:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181460.742289:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385297792:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 426us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181460.742298:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00010000:00010000:2.0:1789181460.744206:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7371085/0x76fb55528351790a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8087 expref: 7 pid: 8435 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.744235:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408440704:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181460.744285:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.744298:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.744306:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.744340:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.744349:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.744358:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.744365:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a000 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181460.744370:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.744378:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.744396:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.744410:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb55528351792d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.744678:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385297664:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 8358us (9003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.744688:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:3.0:1789181460.749492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181460.750231:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385298048 00000100:00100000:0.0:1789181460.750243:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385298048 00000100:00100000:0.0:1789181460.750303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:0.0:1789181460.750314:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:11403:x1876092385298048:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789181460.750399:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.750436:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8033 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.750446:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.750662:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8033 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.750677:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8033 expref: 16 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.750691:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408440832:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181460.751040:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181460.756979:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408440832:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181460.757013:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181460.759608:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181460.759944:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385298176 00000100:00100000:2.0:1789181460.759956:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385298176 00010000:00010000:2.0:1789181460.760003:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8033 expref: 17 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.760045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:2.0:1789181460.760055:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:2394:x1876092385298176:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181460.760069:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181460.760076:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8033 expref: 17 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.760089:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8033 expref: 17 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.760111:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517823 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8033 expref: 17 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.760128:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181460.760133:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517885 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8056 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.760172:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.760181:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.760188:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.760221:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181460.760327:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:2394:x1876092385298176:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 273us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.760336:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00010000:00010000:0.0:1789181460.760945:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.760956:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.761135:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.761149:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb5552835178ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8072 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.761311:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.761345:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb5552835178ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8072 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.761360:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb5552835178ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8072 expref: 16 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.761373:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408440960:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181460.761437:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181460.769254:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.769388:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385298304 00000100:00100000:3.0:1789181460.769398:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385298304 00010000:00010000:3.0:1789181460.769437:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb5552835178ee lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8072 expref: 17 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181460.769678:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:3.0:1789181460.769692:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:2394:x1876092385298304:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181460.769710:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181460.769773:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb5552835178ee lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8072 expref: 17 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.769786:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb5552835178ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8072 expref: 17 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.769822:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181460.769827:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.769836:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.769844:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.769865:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181460.769948:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:2394:x1876092385298304:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 260us (703us total) trans 0 rc 0/0 00010000:00010000:0.0:1789181460.770043:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb5552835178ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8072 expref: 17 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.770061:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408440960:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181460.770083:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.770092:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.770099:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181460.770224:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1789181460.770337:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1789181460.770372:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789181460.770494:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876092408441088:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789181460.770545:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181460.771780:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181460.771832:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408441088 00000100:00100000:0.0:1789181460.771840:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408441088 00000100:00100000:0.0:1789181460.771891:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789181460.771899:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876092408441088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789181460.772228:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876092408441088:12345-0@lo:1000:mdt00_000.0 Request processed in 261us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181460.772236:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789181460.772286:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789181460.772293:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789181460.772361:0:6521:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c1dff906680 x1876092408440192/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789181476 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181460.772374:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876092408441088:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789181460.773456:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1789181460.774304:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876092408441216:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789181460.774367:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181460.774396:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1789181460.774506:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408441216 00000100:00100000:2.0:1789181460.774514:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408441216 00000100:00100000:2.0:1789181460.774573:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789181460.774583:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1876092408441216:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789181460.775157:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1876092408441216:12345-0@lo:1000:mdt00_000.0 Request processed in 173us (387us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789181460.775175:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789181460.775225:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876092408441216:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789181460.775271:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775281:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775289:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775312:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181460.775316:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775324:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775340:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:2.0:1789181460.775343:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181460.775348:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775354:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351793b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775378:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775383:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775388:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775392:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181460.775395:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775400:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775416:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181460.775418:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181460.775425:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517885 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8056 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775436:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517885 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8056 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775445:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517885 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8056 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.775748:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517885 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8056 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.775998:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408441344:192.168.202.1@tcp:105: 00000100:00100000:2.0:1789181460.776098:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181460.784105:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:1.0:1789181460.786212:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.786289:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385298432 00000100:00100000:3.0:1789181460.786299:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385298432 00000100:00100000:3.0:1789181460.786361:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1789181460.786372:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:11402:x1876092385298432:12345-192.168.202.1@tcp:49:lfs.0 00000100:00100000:3.0:1789181460.786526:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:11402:x1876092385298432:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 155us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.786533:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1789181460.787468:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408441344:192.168.202.1@tcp:105: 00010000:00010000:0.0:1789181460.787513:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787527:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351787e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787576:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517942 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787611:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787623:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787633:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787639:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517942 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787646:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517942 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787652:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181460.787656:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517942 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787663:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517942 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787674:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:0.0:1789181460.787677:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181460.787681:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517942 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787686:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517942 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787695:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787707:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787713:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787878:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181460.787882:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787889:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787898:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:0.0:1789181460.787900:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789181460.787903:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.787909:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517934 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.788131:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:11403:x1876092385298048:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 37818us (38652us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789181460.788141:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000020:00080000:0.0:1789181460.788147:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789181460.788492:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181460.788497:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181460.789338:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789181460.789352:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181460.796375:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.797269:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385298688 00000100:00100000:3.0:1789181460.797284:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385298688 00000100:00100000:3.0:1789181460.797387:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:3.0:1789181460.797399:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd13d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:11403:x1876092385298688:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789181460.797700:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789181460.797781:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1789181460.797848:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.797866:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.797876:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.797905:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.797922:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.797929:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.797945:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789181460.798031:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd13d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:11403:x1876092385298688:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 634us (1664us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789181460.798039:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000020:00080000:3.0:1789181460.798044:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789181460.798128:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181460.798136:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.798143:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ee00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181460.798148:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.798156:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.798180:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:2.0:1789181460.798188:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789181460.798193:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.798200:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517949 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.798211:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181460.798213:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181460.798215:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181460.802344:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.802453:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385298944 00000100:00100000:3.0:1789181460.802466:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385298944 00000100:00100000:3.0:1789181460.802966:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:3.0:1789181460.802979:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:11402:x1876092385298944:12345-192.168.202.1@tcp:58:lfs.0 00000040:00080000:3.0:1789181460.803663:0:9021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789181460.804686:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:11402:x1876092385298944:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 1702us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.804697:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:0.0:1789181460.855251:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181460.855407:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385299072 00000100:00100000:3.0:1789181460.855417:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385299072 00000100:00100000:3.0:1789181460.855484:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:3.0:1789181460.855496:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:11405:x1876092385299072:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181460.855522:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.855569:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517950 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df808e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855642:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517957 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855656:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517957 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855668:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517957 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855683:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb55528351795e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855690:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb55528351795e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855695:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb55528351795e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855831:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855844:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df804f expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855853:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855889:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df804f expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.855927:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df804f expref: 22 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181460.855942:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4dee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408441472:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181460.856042:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27a3900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181460.860409:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181460.860652:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385299328 00000100:00100000:2.0:1789181460.860662:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385299328 00000100:00100000:2.0:1789181460.860760:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:2.0:1789181460.860774:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:6166:x1876092385299328:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789181460.861070:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:6166:x1876092385299328:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 299us (670us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789181460.861079:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1789181460.863109:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4dee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408441472:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181460.863138:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.864122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181460.864315:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385299456 00000100:00100000:2.0:1789181460.864324:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385299456 00010000:00010000:2.0:1789181460.864363:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df804f expref: 24 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.864403:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:2.0:1789181460.864412:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:2393:x1876092385299456:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181460.864427:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181460.864434:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df804f expref: 24 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.864445:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df804f expref: 24 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.864494:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517870 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df804f expref: 24 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.864511:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181460.864516:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.864526:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.864536:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.864906:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181460.864961:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:2393:x1876092385299456:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 548us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.864970:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00010000:00010000:0.0:1789181460.871412:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181460.871454:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181460.871861:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789181460.871867:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181460.871892:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.871988:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872002:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517957 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872010:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517957 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872103:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517957 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872109:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ea00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181460.872114:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517957 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872121:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517957 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872137:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:2.0:1789181460.872140:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181460.872144:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517957 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872151:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517957 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872169:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb55528351795e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872176:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb55528351795e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872181:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb55528351795e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872186:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181460.872189:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb55528351795e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872205:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb55528351795e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872214:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c1dfadc6900) 00010000:00010000:2.0:1789181460.872217:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181460.872220:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb55528351795e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872226:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb55528351795e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872273:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517950 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df808e expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872287:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df808e expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.872294:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181460.872296:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181460.872298:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f000, rc 0) 00000100:00100000:2.0:1789181460.872429:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11405:x1876092385299072:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 16932us (17189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.872439:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00010000:00010000:3.0:1789181461.004254:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181461.826776:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181461.826801:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181461.826835:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789181461.826841:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789181461.837182:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181461.837190:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181461.837223:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789181461.837229:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789181461.837475:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4debb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408441600:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789181461.837605:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181461.846309:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4debb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408441600:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789181461.851103:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181461.851400:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385299584 00000100:00100000:0.0:1789181461.851412:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385299584 00000100:00100000:0.0:1789181461.851473:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:0.0:1789181461.851484:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11417:x1876092385299584:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789181461.851522:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789181461.851914:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11417:x1876092385299584:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 429us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181461.851923:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:2.0:1789181461.855512:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181461.855630:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385299840 00000100:00100000:3.0:1789181461.855643:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385299840 00000100:00100000:3.0:1789181461.856015:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:3.0:1789181461.856027:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:11417:x1876092385299840:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181461.856049:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181461.856070:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351796c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.856186:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517973 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.856202:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.856217:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181461.856239:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789181461.856358:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb55528351796c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8095 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.856376:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8095 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.856385:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:3.0:1789181461.856388:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181461.856392:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e000, rc 0) 00000100:00100000:3.0:1789181461.856500:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:11417:x1876092385299840:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 475us (997us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789181461.856509:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:0.0:1789181461.877015:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181461.877052:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385300224 00000100:00100000:3.0:1789181461.877062:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385300224 00000100:00100000:0.0:1789181461.877062:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181461.877121:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:1.0:1789181461.877127:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385299968 00000100:00100000:1.0:1789181461.877131:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385299968 00000100:00100000:3.0:1789181461.877132:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:11417:x1876092385300224:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789181461.877172:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1789181461.877179:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:2395:x1876092385299968:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181461.877190:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181461.877214:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517973 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8095 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.877222:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517981 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.877238:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517981 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.877250:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517981 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181461.877630:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:3.0:1789181461.877638:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517981 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181461.877638:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181461.877654:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517981 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.877661:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517981 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.877667:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181461.877672:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517981 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.877681:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517981 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.877691:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:3.0:1789181461.877693:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789181461.877697:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517981 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181461.877703:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517981 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181461.878127:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181461.878132:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1789181461.878265:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:2395:x1876092385299968:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1083us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181461.878274:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1789181461.878294:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:11417:x1876092385300224:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 1163us (1948us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789181461.878301:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:0.0:1789181461.880709:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181461.880905:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385300480 00000100:00100000:1.0:1789181461.880915:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385300480 00000100:00100000:1.0:1789181461.880970:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1789181461.880981:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:11417:x1876092385300480:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789181461.881198:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:11417:x1876092385300480:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 218us (497us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789181461.881216:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000040:00080000:2.0:1789181461.881564:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789181461.881577:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789181462.029366:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181462.288364:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408441728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181462.288457:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181462.288870:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408441728 00000100:00100000:1.0:1789181462.288881:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408441728 00000100:00100000:1.0:1789181462.288939:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789181462.288949:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408441728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181462.288988:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181462.289059:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408441728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181462.289067:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789181462.290166:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408441728:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789181463.054254:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181463.125834:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789181463.713715:0:14367:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181463.713748:0:14367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789181463.713790:0:14367:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789181463.713796:0:14367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181463.820006:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408441856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181463.820087:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181463.820627:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408441856 00000100:00100000:3.0:1789181463.820636:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408441856 00000100:00080000:0.0:1789181463.820684:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181463.820701:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789181463.820712:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876092408441856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181463.820785:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181463.820797:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408441984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181463.820829:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181463.820836:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876092408441856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181463.820843:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789181463.820858:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408441984 00000100:00100000:3.0:1789181463.820861:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408441984 00000100:00100000:3.0:1789181463.820905:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789181463.820910:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408441856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181463.820911:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408441984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181463.820920:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181463.820956:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408441984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181463.820963:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1789181463.820993:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181463.821059:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408441984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181463.912856:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181463.912990:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385300608 00000100:00100000:2.0:1789181463.913002:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385300608 00000100:00100000:2.0:1789181463.913061:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 386 00000100:00100000:2.0:1789181463.913072:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385300608:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181463.923343:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385300608:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 10260us (10485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181463.923360:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 386 00000100:00100000:3.0:1789181463.931452:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181463.931513:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181463.931545:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181463.931567:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181463.931585:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181463.931606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181463.931625:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181463.931651:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385300864 00000100:00100000:3.0:1789181463.931661:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385300864 00000100:00100000:3.0:1789181463.931710:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385301376 00000100:00100000:3.0:1789181463.931714:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385301376 00000100:00100000:3.0:1789181463.931775:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385300736 00000100:00100000:3.0:1789181463.931779:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385300736 00000100:00100000:3.0:1789181463.931795:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385301248 00000100:00100000:3.0:1789181463.931797:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385301248 00000100:00100000:3.0:1789181463.931810:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385301632 00000100:00100000:3.0:1789181463.931823:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385301632 00000100:00100000:3.0:1789181463.931846:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 311 00000100:00100000:3.0:1789181463.931858:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385300864:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181463.932010:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 312 00000100:00100000:2.0:1789181463.932022:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385301376:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181463.932110:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385301376:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 92us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181463.932119:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 312 00000100:00100000:2.0:1789181463.932140:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 313 00000100:00100000:2.0:1789181463.932147:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+26:2393:x1876092385300736:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181463.932178:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+26:2393:x1876092385300736:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181463.932184:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 313 00000100:00100000:2.0:1789181463.932197:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 314 00000100:00100000:2.0:1789181463.932211:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385301248:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181463.932239:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385301248:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181463.932245:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 314 00000100:00100000:2.0:1789181463.932258:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:2.0:1789181463.932265:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:11438:x1876092385301632:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181463.932277:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181463.932303:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517988 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df809c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181463.932433:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb55528351798f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181463.932451:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb55528351798f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181463.932465:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb55528351798f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181463.932478:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789181463.932619:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb555283517988 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df809c expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181463.932639:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb55528351798f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df809c expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181463.932650:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181463.932653:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789181463.932665:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a600, rc 0) 00000100:00100000:2.0:1789181463.932689:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:11438:x1876092385301632:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 424us (1063us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789181463.932695:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:2.0:1789181463.932928:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385301120 00000100:00100000:2.0:1789181463.932936:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385301120 00000100:00100000:2.0:1789181463.932970:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385300992 00000100:00100000:2.0:1789181463.932973:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385300992 00000100:00100000:2.0:1789181463.932997:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:2.0:1789181463.933004:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385301120:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181463.933037:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385301120:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181463.933043:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:2.0:1789181463.933056:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:2.0:1789181463.933062:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385300992:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181463.933084:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385300992:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181463.933090:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00080000:2.0:1789181463.933109:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181463.933113:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181463.933116:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181463.933118:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181463.936602:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385300864:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 4732us (5145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181463.936618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 311 00000100:00100000:2.0:1789181463.937213:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181463.937454:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385301760 00000100:00100000:3.0:1789181463.937466:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385301760 00000100:00100000:3.0:1789181463.937520:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:3.0:1789181463.937529:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:11438:x1876092385301760:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1789181463.937590:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351799d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181463.937608:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351799d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181463.937621:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351799d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181463.937661:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351799d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181463.937667:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351799d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181463.937674:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351799d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181463.937681:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fc00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181463.937685:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351799d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181463.937708:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351799d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181463.937747:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:3.0:1789181463.937750:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181463.937756:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351799d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181463.937774:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fc00/0x76fb55528351799d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181463.937833:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:11438:x1876092385301760:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 305us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181463.937840:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000040:00080000:0.0:1789181463.950077:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181463.950088:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181463.950107:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789181463.950113:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181464.031326:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181464.031475:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385301888 00000100:00100000:3.0:1789181464.031488:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385301888 00000100:00100000:3.0:1789181464.031568:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1789181464.031579:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385301888:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:3.0:1789181464.031600:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181464.031622:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9ae9c5c/0x76fb5552835179a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80a3 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789181464.031649:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4be13, atime: 0x6aa4be12, ctime: 0x6aa4be13, blocks: 0x8 00010000:00010000:3.0:1789181464.031672:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1789181464.031678:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181464.031689:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ae9c5c/0x76fb5552835179a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80a3 expref: 7 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181464.032021:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9ae9c5c/0x76fb5552835179a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80a3 expref: 7 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181464.032036:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fc00, rc 0) 00000100:00100000:3.0:1789181464.032139:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385301888:12345-192.168.202.1@tcp:101:cat.0 Request processed in 560us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181464.032147:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:0.0:1789181464.039530:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181464.039632:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385302016 00000100:00100000:2.0:1789181464.039644:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385302016 00002000:00100000:2.0:1789181464.039704:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9c1dd8ba3480 x1876092385302016/t0(0) o3->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:595/0 lens 488/0 e 0 to 0 dl 1789181475 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181464.039793:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dd8ba3480 with x1876092385302016 ext(0->4095) 00002000:00010000:2.0:1789181464.039800:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1dd8ba3480 00000100:00100000:2.0:1789181464.039826:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:2.0:1789181464.039838:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385302016:12345-192.168.202.1@tcp:3:cat.0 00000100:00100000:2.0:1789181464.040101:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385302016:12345-192.168.202.1@tcp:3:cat.0 Request processed in 264us (590us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789181464.040111:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00002000:00100000:2.0:1789181464.040118:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9c1dd8ba3480 x1876092385302016/t0(0) o3->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:595/0 lens 488/4536 e 0 to 0 dl 1789181475 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181464.040127:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dd8ba3480 with x1876092385302016 ext(0->4095) 00002000:00010000:2.0:1789181464.040130:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1dd8ba3480 00010000:00010000:3.0:1789181464.076272:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181464.848646:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408442112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181464.848867:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181464.848961:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408442112 00000100:00100000:3.0:1789181464.848969:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408442112 00000100:00100000:3.0:1789181464.849022:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789181464.849032:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408442112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181464.849074:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789181464.849123:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408442112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181464.849131:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789181464.849181:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408442112:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1789181464.854346:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1789181464.854363:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:0.0:1789181465.117693:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181465.355952:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181465.355977:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408442240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181465.356055:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181465.356128:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408442240 00000100:00100000:0.0:1789181465.356137:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408442240 00000100:00100000:0.0:1789181465.356199:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789181465.356210:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408442240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181465.356240:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789181465.356280:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408442240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181465.356287:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1789181465.356307:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181465.356340:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408442240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181465.356565:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408442496:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.356605:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181465.356630:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408443008:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.356652:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181465.356672:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408443520:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.356691:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181465.356712:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789181465.356719:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408442368:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.356789:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181465.356814:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408442880:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.356837:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181465.356855:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408443392:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.356878:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181465.356931:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408442752:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.356958:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181465.356978:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408443264:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.357000:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181465.357017:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408443776:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.357036:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181465.357114:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408442368 00000100:00100000:0.0:1789181465.357119:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408442368 00000100:00100000:0.0:1789181465.357153:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789181465.357160:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408442368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181465.357209:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408442368:12345-0@lo:400:kworker.0 Request processed in 49us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181465.357216:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789181465.357255:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408442368:0@lo:400:kworker.0 00000004:00080000:0.0:1789181465.358638:0:9990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421345911696ns, next at 422345909147ns, rc = 0 00000100:00100000:0.0:1789181465.358664:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408443904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181465.358718:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181465.358793:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408443904 00000100:00100000:0.0:1789181465.358800:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408443904 00000100:00100000:0.0:1789181465.358844:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789181465.358852:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876092408443904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181465.358871:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789181465.358912:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876092408443904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181465.358918:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1789181465.359112:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181465.359143:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408443904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181465.359958:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408442496 00000100:00100000:2.0:1789181465.359966:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408442496 00000100:00100000:2.0:1789181465.359999:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408443008 00000100:00100000:2.0:1789181465.360002:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408443008 00000100:00100000:2.0:1789181465.360022:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408443520 00000100:00100000:2.0:1789181465.360025:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408443520 00000100:00100000:2.0:1789181465.360037:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408442752 00000100:00100000:2.0:1789181465.360040:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408442752 00000100:00100000:2.0:1789181465.360054:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789181465.360062:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408442496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360126:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408442496:12345-0@lo:400:kworker.0 Request processed in 64us (3520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.360132:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789181465.360145:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789181465.360158:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408443008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360189:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408443008:12345-0@lo:400:kworker.0 Request processed in 31us (3535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.360194:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789181465.360206:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789181465.360212:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408443520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360237:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408443520:12345-0@lo:400:kworker.0 Request processed in 25us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.360242:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789181465.360253:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789181465.360258:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408442752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360283:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408442752:12345-0@lo:400:kworker.0 Request processed in 25us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.360288:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789181465.360316:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408442624:0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360350:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181465.360378:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd92aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408443136:0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360399:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181465.360416:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408443648:0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360435:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181465.360465:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408442880 00000100:00100000:2.0:1789181465.360469:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408442880 00000100:00100000:2.0:1789181465.360493:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408442624 00000100:00100000:2.0:1789181465.360497:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408442624 00000100:00100000:2.0:1789181465.360509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789181465.360514:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408442880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360556:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408442880:12345-0@lo:400:kworker.0 Request processed in 41us (3717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.360561:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789181465.360572:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789181465.360578:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408442624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360606:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408442624:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.360612:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789181465.360629:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408443136 00000100:00100000:2.0:1789181465.360633:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408443136 00000100:00100000:2.0:1789181465.360653:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408443648 00000100:00100000:2.0:1789181465.360656:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408443648 00000100:00100000:2.0:1789181465.360669:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789181465.360674:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408443136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360702:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408443136:12345-0@lo:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.360707:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789181465.360718:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789181465.360772:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408443648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.360801:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408443648:12345-0@lo:400:kworker.0 Request processed in 77us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.360806:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789181465.360840:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408442624:0@lo:400:kworker.0 00010000:00080000:2.0:1789181465.360854:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd92aa680 x1876092408443136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181465.360877:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408443136:0@lo:400:kworker.0 00010000:00080000:2.0:1789181465.360889:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc2f01880 x1876092408443648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181465.360896:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408443648:0@lo:400:kworker.0 00000100:00080000:0.0:1789181465.361248:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789181465.361253:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181465.361279:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408442880:0@lo:400:kworker.0 00000100:00100000:0.0:1789181465.361291:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408442496:0@lo:400:kworker.0 00000100:00100000:0.0:1789181465.361302:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408443008:0@lo:400:kworker.0 00000100:00100000:0.0:1789181465.361311:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408443520:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.361966:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408442752:0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.362129:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408443392 00000100:00100000:2.0:1789181465.362135:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408443392 00000100:00100000:2.0:1789181465.362213:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408443264 00000100:00100000:2.0:1789181465.362216:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408443264 00000100:00100000:3.0:1789181465.362791:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408443776 00000100:00100000:3.0:1789181465.362797:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408443776 00000100:00100000:3.0:1789181465.362827:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789181465.362836:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408443392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181465.362916:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408443392:12345-0@lo:400:kworker.0 Request processed in 81us (6037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181465.362932:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789181465.362948:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789181465.362954:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1876092408443776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181465.362992:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1876092408443776:12345-0@lo:400:kworker.0 Request processed in 38us (5954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181465.362997:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789181465.363033:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1789181465.363040:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1789181465.363055:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1cc4470000, transno 4294967305 00000100:00100000:3.0:1789181465.363067:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408443392:0@lo:400:kworker.0 00000100:00100000:1.0:1789181465.364921:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408443776:0@lo:400:kworker.0 00000100:00080000:0.0:1789181465.366570:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181465.371329:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789181465.371346:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408443264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181465.371447:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408443264:12345-0@lo:400:kworker.0 Request processed in 106us (14445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.371455:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789181465.371618:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd92a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408443264:0@lo:400:kworker.0 00000004:00080000:0.0:1789181465.870958:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1789181465.870999:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789181465.871027:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c1de1836000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789181465.871032:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1dfb2f2600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c1de1836f00 00000020:00080000:0.0:1789181465.871035:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1de7daa900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c1dd8ea2800 00000020:00080000:0.0:1789181465.871052:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789181465.871063:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789181465.871125:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1789181465.871224:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.871235:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.871241:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.871247:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fa00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181465.871251:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.871258:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.871275:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181465.871278:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181465.871293:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.871300:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb55528351791f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181465.871451:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408444032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789181465.871527:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181465.871629:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408444032 00000100:00100000:1.0:1789181465.871637:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408444032 00000100:00100000:1.0:1789181465.871691:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789181465.871702:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876092408444032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789181465.871856:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789181465.871860:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789181459 -> 1789181459 00002000:00010000:1.0:1789181465.871862:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1789181458 -> 1789181458 00002000:00010000:1.0:1789181465.871865:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789181459 -> 1789181459 00002000:00010000:1.0:1789181465.871867:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789181465.871925:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3646:x1876092408444032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (397us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789181465.871933:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1789181465.871977:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1dc2f05880/2, rc 0, transno 4294967313 00000100:00100000:1.0:1789181465.871983:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408444032:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1789181465.898857:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1789181465.898962:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:2.0:1789181466.123927:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181467.154409:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181467.403936:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408444160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789181467.404030:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181467.414043:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408444160 00000100:00100000:3.0:1789181467.414057:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408444160 00000100:00100000:2.0:1789181467.414197:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789181467.414210:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408444160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789181467.414250:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789181467.414333:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408444160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (10303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181467.414341:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789181467.414388:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408444160:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789181468.172504:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181468.941230:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181468.941253:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408444288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181468.941338:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181468.941408:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408444288 00000100:00100000:0.0:1789181468.941416:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408444288 00000100:00100000:0.0:1789181468.941479:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789181468.941491:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408444288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181468.941524:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181468.941835:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181468.941860:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408444416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181468.942327:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408444288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 837us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181468.942337:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1789181468.942364:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181468.953835:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408444288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181468.961970:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181468.962031:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408444416 00000100:00100000:3.0:1789181468.962041:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408444416 00000100:00100000:3.0:1789181468.962106:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789181468.962116:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408444416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181468.962143:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181468.962180:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408444416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181468.962187:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1789181468.962206:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181468.962266:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408444416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181469.035303:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181469.035346:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181469.035373:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385302144 00000100:00100000:2.0:1789181469.035386:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385302144 00000100:00100000:2.0:1789181469.035442:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 388 00000100:00100000:2.0:1789181469.035453:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385302144:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181469.035541:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385302144:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181469.035550:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 388 00000100:00100000:2.0:1789181469.035695:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181469.035763:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181469.035784:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181469.035804:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181469.035828:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181469.035848:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385302400 00000100:00100000:2.0:1789181469.035853:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385302400 00000100:00100000:2.0:1789181469.035887:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385302912 00000100:00100000:2.0:1789181469.035890:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385302912 00000100:00100000:2.0:1789181469.035905:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385302272 00000100:00100000:2.0:1789181469.035907:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385302272 00000100:00100000:2.0:1789181469.035918:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385302784 00000100:00100000:2.0:1789181469.035921:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385302784 00000100:00100000:2.0:1789181469.035935:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 321 00000100:00100000:2.0:1789181469.035943:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385302400:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181469.035983:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385302400:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181469.035990:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 321 00000100:00100000:2.0:1789181469.036002:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 322 00000100:00100000:2.0:1789181469.036008:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385302912:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181469.036045:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385302912:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 36us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181469.036052:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 322 00000100:00100000:2.0:1789181469.036063:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 323 00000100:00100000:2.0:1789181469.036070:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:2394:x1876092385302272:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181469.036099:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:2394:x1876092385302272:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181469.036105:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 323 00000100:00100000:2.0:1789181469.036116:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 324 00000100:00100000:2.0:1789181469.036123:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385302784:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181469.036149:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385302784:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181469.036155:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 324 00000100:00100000:2.0:1789181469.036175:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385302656 00000100:00100000:2.0:1789181469.036179:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385302656 00000100:00100000:2.0:1789181469.036205:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385302528 00000100:00100000:2.0:1789181469.036208:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385302528 00000100:00100000:3.0:1789181469.036227:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:3.0:1789181469.036235:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385302656:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181469.036243:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:2.0:1789181469.036248:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385302528:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181469.036267:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385302528:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181469.036271:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385302656:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181469.036274:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:3.0:1789181469.036286:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00080000:2.0:1789181469.036289:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181469.036305:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181469.036307:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181469.036315:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789181469.227118:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181469.502348:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181469.502517:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385303040 00000100:00100000:2.0:1789181469.502527:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385303040 00000100:00100000:2.0:1789181469.502594:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:2.0:1789181469.502603:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:11083:x1876092385303040:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789181469.502704:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:11083:x1876092385303040:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 102us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181469.502721:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:2.0:1789181469.520434:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181469.521106:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385303168 00000100:00100000:1.0:1789181469.521117:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385303168 00000100:00100000:1.0:1789181469.521183:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:1.0:1789181469.521193:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd92aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:11083:x1876092385303168:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789181469.521298:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd92aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:11083:x1876092385303168:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 105us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181469.521305:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:3.0:1789181469.525322:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181469.525424:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385303424 00000100:00100000:0.0:1789181469.525435:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385303424 00000100:00100000:0.0:1789181469.525493:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1789181469.525504:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:11083:x1876092385303424:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789181469.525798:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:11083:x1876092385303424:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 294us (484us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789181469.525806:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1789181469.964185:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc387aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408444544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181469.964263:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181469.964420:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408444544 00000100:00100000:1.0:1789181469.964428:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408444544 00000100:00100000:1.0:1789181469.964480:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789181469.964491:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408444544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181469.964692:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789181469.964786:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408444544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 299us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181469.964794:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789181469.964994:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc387aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408444544:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789181470.284177:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181470.476000:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408444800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181470.476076:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181470.476129:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408444672:0@lo:400:kworker.0 00000100:00100000:3.0:1789181470.476157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181470.476188:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181470.476194:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408444928:0@lo:400:kworker.0 00000100:00100000:3.0:1789181470.476221:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181470.476257:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408444800 00000100:00100000:3.0:1789181470.476266:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408444800 00000100:00100000:3.0:1789181470.476322:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789181470.476333:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc387aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408444800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181470.476368:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789181470.476422:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc387aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408444800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181470.476428:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789181470.476450:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408444672 00000100:00100000:3.0:1789181470.476454:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408444672 00000100:00100000:3.0:1789181470.476475:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789181470.476481:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408444672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181470.476508:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408444672:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181470.476529:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789181470.476832:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789181470.476840:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1dff906680, transno 4294967310 00000004:00080000:3.0:1789181470.476853:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789181470.476883:0:3643:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c1dc2f05880 x1876092408444032/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789181481 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181470.476902:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408444800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181470.476913:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408444672:0@lo:400:kworker.0 00000100:00100000:3.0:1789181470.481066:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408445056:0@lo:400:kworker.0 00000100:00100000:3.0:1789181470.481146:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181470.481194:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181470.481200:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408445184:0@lo:400:kworker.0 00000100:00100000:3.0:1789181470.481224:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181470.481265:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408445056 00000100:00100000:3.0:1789181470.481273:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408445056 00000100:00100000:3.0:1789181470.481320:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789181470.481330:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408445056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181470.481381:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408445056:12345-0@lo:400:kworker.0 Request processed in 52us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181470.481387:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789181470.481424:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408445056:0@lo:400:kworker.0 00000100:00080000:3.0:1789181470.481470:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181470.481482:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408444928 00000100:00100000:3.0:1789181470.481486:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408444928 00000100:00100000:0.0:1789181470.485031:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408445184 00000100:00100000:0.0:1789181470.485050:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408445184 00000100:00100000:0.0:1789181470.485124:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789181470.485135:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408445184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181470.485238:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408445184:12345-0@lo:400:kworker.0 Request processed in 105us (4012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181470.485245:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789181470.485279:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408445440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181470.485318:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181470.485352:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181470.485358:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408445312:0@lo:400:kworker.0 00000100:00100000:0.0:1789181470.485381:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181470.485430:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408445184:0@lo:400:kworker.0 00000100:00100000:0.0:1789181470.485455:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408445312 00000100:00100000:0.0:1789181470.485459:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408445312 00000100:00100000:0.0:1789181470.485488:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789181470.485508:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408445312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181470.485555:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408445312:12345-0@lo:400:kworker.0 Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181470.485575:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789181470.485599:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408445312:0@lo:400:kworker.0 00000100:00100000:0.0:1789181470.485696:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408445440 00000100:00100000:0.0:1789181470.485713:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408445440 00000100:00100000:0.0:1789181470.485776:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789181470.485783:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408445440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181470.485798:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789181470.485849:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408445440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181470.485854:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789181470.485885:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408445440:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789181470.485911:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181470.490282:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789181470.490329:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408444928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181470.490437:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408444928:12345-0@lo:400:kworker.0 Request processed in 119us (14215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181470.490445:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789181470.490511:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408444928:0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.497152:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408445568:0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.497236:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181470.497306:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408445568 00000100:00100000:1.0:1789181470.497313:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408445568 00000100:00100000:1.0:1789181470.497369:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789181470.497378:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408445568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.497432:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408445568:12345-0@lo:400:kworker.0 Request processed in 55us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181470.497438:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:1.0:1789181470.497460:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181470.497490:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408445568:0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.497759:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408445696:0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.497798:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181470.497940:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408445696 00000100:00100000:1.0:1789181470.497945:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408445696 00000100:00100000:1.0:1789181470.498039:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789181470.498047:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408445696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.498083:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408445696:12345-0@lo:400:kworker.0 Request processed in 38us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181470.498090:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:1.0:1789181470.498103:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789181470.498122:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc4461500 x1876092408445696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181470.498134:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408445696:0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.498174:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408446080:0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.498195:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181470.498214:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408446080 00000100:00100000:1.0:1789181470.498217:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408446080 00000100:00100000:1.0:1789181470.498239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789181470.498243:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408446080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.498269:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408446080:12345-0@lo:400:kworker.0 Request processed in 26us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181470.498275:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:1.0:1789181470.498286:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181470.498298:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408446080:0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.498326:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408446208:0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.498353:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181470.498372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408446208 00000100:00100000:1.0:1789181470.498375:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408446208 00000100:00100000:1.0:1789181470.498393:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789181470.498398:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408446208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181470.498422:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408446208:12345-0@lo:400:kworker.0 Request processed in 24us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181470.498427:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:1.0:1789181470.498437:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789181470.498450:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3a7b480 x1876092408446208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181470.498459:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408446208:0@lo:400:kworker.0 00000100:00100000:0.0:1789181470.498572:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408445952:0@lo:400:kworker.0 00000100:00100000:0.0:1789181470.498605:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181470.498636:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181470.498641:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408445824:0@lo:400:kworker.0 00000100:00100000:0.0:1789181470.498661:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181470.499697:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408445952 00000100:00100000:3.0:1789181470.499717:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408445952 00000100:00100000:3.0:1789181470.499795:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408445824 00000100:00100000:3.0:1789181470.499798:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408445824 00000100:00100000:3.0:1789181470.499830:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789181470.499838:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408445952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181470.499903:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408445952:12345-0@lo:400:kworker.0 Request processed in 66us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181470.499909:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789181470.499922:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789181470.499927:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408445824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181470.499952:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408445824:12345-0@lo:400:kworker.0 Request processed in 25us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181470.499958:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1789181470.500522:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181470.500839:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408445824:0@lo:400:kworker.0 00000100:00100000:0.0:1789181470.500855:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408445952:0@lo:400:kworker.0 00010000:00010000:0.0:1789181471.307982:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789181471.647341:0:14564:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:51:09 (1789181469) 00000001:00080000:1.0:1789181472.018571:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1789181472.018589:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789181472.018685:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789181472.018708:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1789181472.018789:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00010000:00010000:3.0:1789181472.332146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181472.524613:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408446336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181472.524706:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181472.524877:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408446336 00000100:00100000:1.0:1789181472.524887:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408446336 00000100:00100000:1.0:1789181472.524946:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789181472.524956:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408446336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181472.524992:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181472.532358:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408446336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7391us (7640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181472.532373:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789181472.532602:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408446336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181473.155895:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181473.155996:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385303680 00000100:00100000:1.0:1789181473.156009:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385303680 00000100:00100000:1.0:1789181473.156101:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:1.0:1789181473.156129:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+13:12157:x1876092385303680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181473.156161:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181473.156185:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb5552835179ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80aa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156266:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb5552835179b2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156281:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb5552835179b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156295:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb5552835179b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156311:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835179b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156317:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835179b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156324:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835179b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156423:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835179c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156432:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835179c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156438:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835179c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181473.156458:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789181473.156551:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb5552835179b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156559:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb5552835179b2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156565:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb5552835179b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156571:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181473.156576:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb5552835179b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156584:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb5552835179b2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156594:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1dc6843a00) 00010000:00010000:1.0:1789181473.156598:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181473.156602:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb5552835179b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156608:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb5552835179b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156621:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835179b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156627:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835179b9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156641:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835179b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156646:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181473.156649:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835179b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156656:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835179b9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156664:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c1dc3dc5900) 00010000:00010000:1.0:1789181473.156666:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181473.156670:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835179b9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.156685:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835179b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789181473.157617:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789181473.161312:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb5552835179ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80aa expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.161345:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835179c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80aa expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181473.161355:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:1.0:1789181473.161358:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181473.161362:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13400, rc 0) 00000100:00100000:1.0:1789181473.161449:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:12157:x1876092385303680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 5324us (5565us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789181473.161479:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 149 00000040:00080000:0.0:1789181473.164244:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181473.164254:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181473.164353:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789181473.164360:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181473.167377:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181473.167634:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385303808 00000100:00100000:3.0:1789181473.167644:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385303808 00000100:00100000:3.0:1789181473.167787:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1789181473.167799:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:2393:x1876092385303808:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181473.167823:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181473.167852:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb5552835179c0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80aa expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181473.167872:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:3.0:1789181473.167877:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181473.167932:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:2393:x1876092385303808:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 136us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181473.167940:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1789181473.168945:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181473.171935:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385303936 00000100:00100000:1.0:1789181473.171953:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385303936 00000100:00100000:1.0:1789181473.172032:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:1.0:1789181473.172042:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:12157:x1876092385303936:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789181473.172190:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:12157:x1876092385303936:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 148us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181473.172197:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:0.0:1789181473.179512:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181473.179591:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385304064 00000100:00100000:3.0:1789181473.179602:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385304064 00000100:00080000:2.0:1789181473.179762:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181473.180111:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 151 00000100:00100000:3.0:1789181473.180135:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:12157:x1876092385304064:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789181473.180255:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:12157:x1876092385304064:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 133us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181473.180267:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 151 00010000:00010000:1.0:1789181473.356963:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181473.357537:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789181474.074582:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408446592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181474.074649:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181474.082636:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408446464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181474.082745:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181474.082904:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408446592 00000100:00100000:3.0:1789181474.082914:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408446592 00000100:00100000:3.0:1789181474.082969:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408446464 00000100:00100000:3.0:1789181474.082972:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408446464 00000100:00100000:3.0:1789181474.082990:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789181474.083000:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408446592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181474.083039:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181474.083090:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408446592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (8441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181474.083097:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789181474.083115:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789181474.083121:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408446464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181474.083132:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181474.083160:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408446464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181474.083166:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1789181474.083180:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181474.083219:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408446464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181474.083508:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408446592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181474.168811:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181474.168857:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181474.168877:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181474.168898:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181474.168915:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181474.168937:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181474.168962:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181474.168992:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385304576 00000100:00100000:2.0:1789181474.169003:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385304576 00000100:00100000:2.0:1789181474.169062:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385304704 00000100:00100000:2.0:1789181474.169065:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385304704 00000100:00100000:2.0:1789181474.169089:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:2.0:1789181474.169098:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385304576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181474.169162:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385304576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 65us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181474.169170:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:2.0:1789181474.169194:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1789181474.169200:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385304704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181474.169225:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385304704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181474.169231:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1789181474.169247:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385304320 00000100:00100000:2.0:1789181474.169250:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385304320 00000100:00100000:2.0:1789181474.169267:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385304832 00000100:00100000:2.0:1789181474.169270:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385304832 00000100:00100000:2.0:1789181474.169282:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385304448 00000100:00100000:2.0:1789181474.169285:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385304448 00000100:00100000:2.0:1789181474.169294:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385304960 00000100:00100000:2.0:1789181474.169295:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385304960 00000100:00100000:2.0:1789181474.169308:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 331 00000100:00100000:2.0:1789181474.169313:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:2393:x1876092385304320:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181474.169339:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:2393:x1876092385304320:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181474.169345:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 331 00000100:00100000:2.0:1789181474.169356:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 332 00000100:00100000:2.0:1789181474.169361:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385304832:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181474.169380:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385304832:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 19us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181474.169385:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 332 00000100:00100000:2.0:1789181474.169395:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 333 00000100:00100000:2.0:1789181474.169400:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385304448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181474.169420:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385304448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181474.169432:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 333 00000100:00100000:2.0:1789181474.169444:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 334 00000100:00100000:2.0:1789181474.169450:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385304960:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181474.169488:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385304960:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 38us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181474.169494:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 334 00000100:00080000:2.0:1789181474.169519:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181474.169523:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181474.169525:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181474.169527:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181474.169915:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385304192 00000100:00100000:0.0:1789181474.169920:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385304192 00000100:00100000:0.0:1789181474.169959:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 390 00000100:00100000:0.0:1789181474.169966:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385304192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181474.169993:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385304192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181474.169999:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 390 00000040:00080000:2.0:1789181474.189476:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181474.189484:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789181474.190324:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1789181474.190335:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789181474.380083:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181475.003441:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.003583:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385305088 00000100:00100000:3.0:1789181475.003595:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385305088 00000100:00100000:3.0:1789181475.003674:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00100000:3.0:1789181475.003686:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:12199:x1876092385305088:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181475.003713:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181475.003751:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb5552835179ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80b1 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003828:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835179d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003844:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835179d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003854:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835179d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003879:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb5552835179dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003887:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb5552835179dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003893:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb5552835179dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003932:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835179d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003937:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835179d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003941:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835179d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003945:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fa00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181475.003948:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835179d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003952:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835179d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003961:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc6843000) 00010000:00010000:3.0:1789181475.003963:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181475.003976:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835179d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003980:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb5552835179d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.003996:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb5552835179dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.004002:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb5552835179dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.004008:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb5552835179dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.004014:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181475.004017:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb5552835179dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.004023:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb5552835179dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.004030:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c1dfadc6a00) 00010000:00010000:3.0:1789181475.004033:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181475.004035:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb5552835179dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.004040:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb5552835179dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.004069:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb5552835179ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80b1 expref: 15 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.004078:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc6843000) 00010000:00010000:3.0:1789181475.004080:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181475.004090:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb5552835179ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80b1 expref: 15 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.004099:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e000, rc 0) 00000100:00100000:3.0:1789181475.004151:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:12199:x1876092385305088:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 469us (730us total) trans 0 rc 301/301 00000100:00100000:3.0:1789181475.004157:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 152 00000100:00080000:2.0:1789181475.005050:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181475.018397:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.018632:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385305344 00000100:00100000:3.0:1789181475.018641:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385305344 00000100:00100000:3.0:1789181475.018717:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:3.0:1789181475.018749:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+14:12199:x1876092385305344:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:3.0:1789181475.018809:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181475.018834:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678a00/0x76fb555283517330 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7edc expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.018849:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc6843000) 00010000:00010000:3.0:1789181475.018858:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181475.018907:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835179e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.018918:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835179e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.018925:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835179e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.018933:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.018937:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.018952:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019339:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019346:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019351:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181475.019361:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070df5597 reply state 00000000e197f9fb transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019368:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019373:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:3.0:1789181475.019375:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181475.019377:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789181475.019380:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789181475.019385:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835179e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019390:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835179e3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019394:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835179e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019398:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fe00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181475.019406:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835179e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019411:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835179e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019417:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181475.019429:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181475.019432:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835179e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019436:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb5552835179e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181475.019445:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070df5597 reply state 00000000e197f9fb transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019450:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.019454:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c1dfadc6500) 00010000:00010000:3.0:1789181475.019455:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181475.019456:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789181475.019532:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:12199:x1876092385305344:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 784us (1140us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789181475.019539:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 153 00000100:00100000:0.0:1789181475.085647:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181475.085684:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408446720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181475.085887:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181475.085960:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408446720 00000100:00100000:0.0:1789181475.085969:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408446720 00000100:00100000:0.0:1789181475.086017:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789181475.086027:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408446720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181475.086062:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789181475.086107:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408446720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181475.086114:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789181475.086159:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408446720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181475.093339:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181475.093630:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385305472 00000100:00100000:2.0:1789181475.093641:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385305472 00000100:00100000:2.0:1789181475.093713:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:2.0:1789181475.093749:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+15:12207:x1876092385305472:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:2.0:1789181475.093774:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181475.093797:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb5552835179f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80b8 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.093862:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835179ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.093894:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835179ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.093906:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835179ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181475.093956:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789181475.093960:0:9021:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181475.093984:0:9021:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835179ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.094003:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb5552835179f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80b8 expref: 17 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.094013:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835179ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80b8 expref: 16 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.094019:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dd8258700) 00010000:00010000:2.0:1789181475.094022:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181475.094025:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b800, rc 0) 00000100:00100000:2.0:1789181475.094074:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:12207:x1876092385305472:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 353us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181475.094081:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 154 00000100:00100000:1.0:1789181475.139203:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.139289:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385305600 00000100:00100000:3.0:1789181475.139300:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385305600 00000100:00100000:3.0:1789181475.139359:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:3.0:1789181475.139369:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+16:12213:x1876092385305600:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1789181475.139409:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181475.139619:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517a06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80bf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.139694:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.139708:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.139718:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.139903:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.139914:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.139921:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140000:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517a1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140009:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140017:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181475.140057:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789181475.140068:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181475.140091:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140103:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140110:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140117:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140123:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181475.140128:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140135:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140148:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dd8258700) 00010000:00010000:3.0:1789181475.140150:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181475.140156:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140162:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140178:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140185:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140200:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140205:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181475.140208:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140214:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140221:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c1dfadc6500) 00010000:00010000:3.0:1789181475.140224:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181475.140227:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140233:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140259:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517a06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80bf expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140272:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80bf expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.140279:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:3.0:1789181475.140281:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789181475.140283:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fa00, rc 0) 00000100:00100000:3.0:1789181475.140363:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:12213:x1876092385305600:12345-192.168.202.1@tcp:101:bash.0 Request processed in 995us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.140378:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 155 00000100:00100000:1.0:1789181475.145136:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.145216:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385305856 00000100:00100000:3.0:1789181475.145227:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385305856 00000100:00100000:3.0:1789181475.145290:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:3.0:1789181475.145301:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+17:12213:x1876092385305856:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1789181475.145320:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181475.145340:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517a22 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80c6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.145457:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.145481:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.145492:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.145532:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.145540:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.145547:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181475.145926:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789181475.146052:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146073:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146082:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146113:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146121:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a29 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146129:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146136:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181475.146140:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146148:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146160:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:3.0:1789181475.146163:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181475.146168:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a29 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146175:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181475.146189:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006448b4f8 reply state 000000007c0658d0 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146206:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146212:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181475.146215:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181475.146218:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789181475.146248:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517a22 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80c6 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146263:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80c6 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.146270:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6a00) 00010000:00010000:3.0:1789181475.146272:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181475.146274:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc0031600, rc 0) 00000100:00100000:3.0:1789181475.146343:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:12213:x1876092385305856:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1043us (1215us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789181475.146352:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 156 00000100:00100000:2.0:1789181475.150130:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.150210:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385305984 00000100:00100000:3.0:1789181475.150221:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385305984 00000100:00100000:3.0:1789181475.150280:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:3.0:1789181475.150290:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385305984:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1789181475.150307:0:8629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181475.150327:0:8629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6c22fff/0x76fb555283517a45 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80cd expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789181475.150353:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789181475.150385:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=431s v=(0 0) 00010000:00010000:3.0:1789181475.150391:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181475.150401:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6c22fff/0x76fb555283517a45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80cd expref: 6 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.150435:0:8629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6c22fff/0x76fb555283517a45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80cd expref: 6 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.150450:0:8629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fe00, rc 0) 00000100:00100000:3.0:1789181475.150511:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385305984:12345-192.168.202.1@tcp:101:bash.0 Request processed in 223us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.150518:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1789181475.157795:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181475.157909:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385306112 00000100:00100000:2.0:1789181475.157919:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385306112 00000100:00100000:2.0:1789181475.157971:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:2.0:1789181475.157979:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:12213:x1876092385306112:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1789181475.158008:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181475.158027:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80d4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.158061:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6c22fff/0x76fb555283517a45 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80cd expref: 7 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.158071:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181475.158075:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181475.158079:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.158112:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6c22fff/0x76fb555283517a45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80cd expref: 7 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.158126:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6c22fff/0x76fb555283517a45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80cd expref: 7 pid: 8629 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181475.158141:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1876092408446848:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181475.158241:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd930c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181475.160184:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.160260:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385306240 00000100:00100000:3.0:1789181475.160267:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385306240 00010000:00010000:3.0:1789181475.160297:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6c22fff/0x76fb555283517a45 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80cd expref: 8 pid: 8629 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181475.160331:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:3.0:1789181475.160337:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385306240:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181475.160347:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181475.160364:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6c22fff/0x76fb555283517a45 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80cd expref: 8 pid: 8629 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.160373:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6c22fff/0x76fb555283517a45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80cd expref: 8 pid: 8629 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.160407:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181475.160410:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181475.160415:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.160422:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.160454:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181475.160476:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc255aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1876092408446976:192.168.202.1@tcp:105: 00000100:00100000:3.0:1789181475.160548:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31480 going to sleep for 11 seconds 00010000:00010000:2.0:1789181475.160792:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6c22fff/0x76fb555283517a45 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80cd expref: 8 pid: 8629 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181475.160809:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1876092408446848:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181475.160830:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.160849:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a000, rc 0) 00000100:00100000:2.0:1789181475.160902:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:12213:x1876092385306112:12345-192.168.202.1@tcp:101:bash.0 Request processed in 2923us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181475.160911:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1789181475.162237:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc255aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1876092408446976:192.168.202.1@tcp:105: 00010000:00010000:0.0:1789181475.162254:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181475.162290:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2394:x1876092385306240:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1953us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181475.162298:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:1.0:1789181475.164070:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181475.164163:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385306496 00000100:00100000:0.0:1789181475.164172:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385306496 00000100:00100000:0.0:1789181475.164252:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:0.0:1789181475.164261:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:12213:x1876092385306496:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:0.0:1789181475.164551:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:12213:x1876092385306496:12345-192.168.202.1@tcp:35:bash.0 Request processed in 290us (486us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789181475.164560:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1789181475.225591:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181475.225764:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385306752 00000100:00100000:1.0:1789181475.225775:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385306752 00000100:00100000:1.0:1789181475.225900:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:1.0:1789181475.225910:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc255aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:12223:x1876092385306752:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181475.225937:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181475.225954:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517a53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80db expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181475.226113:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789181475.226204:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517a53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80db expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.226214:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dd8258700) 00010000:00010000:1.0:1789181475.226216:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181475.226220:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517a53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80db expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.226230:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13400, rc 0) 00000100:00100000:1.0:1789181475.226325:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc255aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:12223:x1876092385306752:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 416us (749us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1789181475.226330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 157 00000100:00100000:2.0:1789181475.230062:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181475.230178:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385307008 00000100:00100000:1.0:1789181475.230187:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385307008 00000100:00100000:1.0:1789181475.230234:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1789181475.230241:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:12223:x1876092385307008:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1789181475.230453:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:12223:x1876092385307008:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 211us (397us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789181475.230470:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1789181475.301363:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.301444:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385307136 00000100:00100000:3.0:1789181475.301457:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385307136 00000100:00100000:3.0:1789181475.301532:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:3.0:1789181475.301543:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:12229:x1876092385307136:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181475.301566:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181475.301585:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517a61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80e2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.301648:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.301695:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.301717:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181475.301789:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789181475.301793:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181475.301814:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.301840:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517a61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80e2 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.301853:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80e2 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.301859:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:3.0:1789181475.301861:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181475.301864:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e200, rc 0) 00000100:00100000:3.0:1789181475.301932:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:12229:x1876092385307136:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 391us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.301937:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 158 00000100:00100000:3.0:1789181475.305117:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181475.305246:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385307392 00000100:00100000:1.0:1789181475.305255:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385307392 00000100:00100000:1.0:1789181475.305301:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:1.0:1789181475.305310:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:12229:x1876092385307392:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181475.305331:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181475.305363:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517a6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80e9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.305492:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517a76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.305505:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.305518:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181475.305528:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789181475.305630:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517a6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80e9 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.305648:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517a76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80e9 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.305666:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6a00) 00010000:00010000:1.0:1789181475.305670:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181475.305674:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13a00, rc 0) 00000100:00100000:1.0:1789181475.306147:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+26:12229:x1876092385307392:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 835us (1037us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1789181475.306156:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 159 00000100:00100000:1.0:1789181475.310260:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181475.310313:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181475.310369:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385307776 00000100:00100000:0.0:1789181475.310377:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385307776 00000100:00100000:0.0:1789181475.310479:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1789181475.310488:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+26:2394:x1876092385307776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181475.310504:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181475.310530:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517a76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80e9 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.310548:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6a00) 00010000:00010000:0.0:1789181475.310554:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181475.310605:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:2394:x1876092385307776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 118us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181475.310611:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1789181475.311283:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385307648 00000100:00100000:3.0:1789181475.311291:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385307648 00000100:00100000:3.0:1789181475.311338:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:3.0:1789181475.311347:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:12229:x1876092385307648:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181475.311367:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181475.311381:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80f0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.311511:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.311525:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.311536:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181475.311548:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789181475.311644:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517a84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80f0 expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.311672:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80f0 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.311681:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6a00) 00010000:00010000:3.0:1789181475.311684:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789181475.311686:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e000, rc 0) 00000100:00100000:3.0:1789181475.311739:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:12229:x1876092385307648:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 377us (1469us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789181475.311744:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 160 00000100:00100000:1.0:1789181475.318344:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.318585:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385307904 00000100:00100000:3.0:1789181475.318596:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385307904 00000100:00100000:3.0:1789181475.318653:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1789181475.318673:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2396:x1876092385307904:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:3.0:1789181475.318718:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.318785:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.318803:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181475.318808:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181475.318814:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.318850:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.318861:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 6 pid: 8435 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181475.318875:0:8629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc35fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1876092408447104:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181475.318955:0:8629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31780 going to sleep for 11 seconds 00000100:00100000:2.0:1789181475.321706:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181475.321910:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385308032 00000100:00100000:1.0:1789181475.321921:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385308032 00002000:00100000:1.0:1789181475.322012:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c1dff9c9c00 x1876092385308032/t0(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:606/0 lens 504/0 e 0 to 0 dl 1789181486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181475.322023:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dff9c9c00 with x1876092385308032 ext(0->12) 00010000:00010000:1.0:1789181475.322031:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 7 pid: 8435 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.322047:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 7 pid: 8435 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181475.322055:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c1dff9c9c00 00000100:00100000:1.0:1789181475.322091:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:1.0:1789181475.322100:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385308032:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:1.0:1789181475.323190:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385308032:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 1086us (1490us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789181475.323198:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00002000:00100000:1.0:1789181475.323207:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c1dff9c9c00 x1876092385308032/t4294967306(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:606/0 lens 504/448 e 0 to 0 dl 1789181486 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181475.323213:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dff9c9c00 with x1876092385308032 ext(0->12) 00010000:00010000:1.0:1789181475.323218:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 9 pid: 8435 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.323230:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 9 pid: 8435 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181475.323235:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c1dff9c9c00 00000100:00100000:3.0:1789181475.323651:0:8629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc35fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8629:1876092408447104:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181475.323688:0:8629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181475.325630:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181475.325837:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385308160 00000100:00100000:0.0:1789181475.325845:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385308160 00010000:00010000:0.0:1789181475.325877:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 9 pid: 8435 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181475.325923:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:0.0:1789181475.325931:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385308160:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181475.325944:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789181475.325958:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789181475.325960:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789181474 00002000:00010000:0.0:1789181475.325962:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789181475 00002000:00010000:0.0:1789181475.325963:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789181474 00002000:00010000:0.0:1789181475.325965:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789181475.325969:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 9 pid: 8435 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.325978:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 9 pid: 8435 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.326064:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb555283517a4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80d4 expref: 9 pid: 8435 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.326080:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181475.326084:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181475.326089:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.326117:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.326163:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181475.326214:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385308160:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 284us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181475.326219:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00010000:00010000:2.0:1789181475.327003:0:8629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.327017:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.327044:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.327053:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.327061:0:8629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.327070:0:8629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ee00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181475.327075:0:8629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.327095:0:8629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.327106:0:8629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.327114:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009494beb4/0x76fb555283517a99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181475.327184:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2396:x1876092385307904:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 8513us (8847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181475.327191:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:1.0:1789181475.329797:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181475.329911:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385308416 00000100:00100000:2.0:1789181475.329921:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385308416 00000100:00100000:2.0:1789181475.329968:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:2.0:1789181475.329976:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd13d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:12229:x1876092385308416:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:2.0:1789181475.330045:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80f0 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181475.330209:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1789181475.330235:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789181475.330544:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1789181475.330576:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.330586:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80c6 expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.330601:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.330632:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80c6 expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.330645:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80c6 expref: 31 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181475.330673:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff9c8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876092408447232:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181475.330767:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd930c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789181475.333196:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff9c8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876092408447232:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181475.333218:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181475.334161:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181475.334592:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385308544 00000100:00100000:2.0:1789181475.334600:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385308544 00010000:00010000:2.0:1789181475.334645:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80c6 expref: 32 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181475.334866:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:2.0:1789181475.334879:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:2394:x1876092385308544:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181475.334901:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181475.334909:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80c6 expref: 32 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.334945:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80c6 expref: 32 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.334966:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283517a37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80c6 expref: 32 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.334979:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6a00) 00010000:00010000:2.0:1789181475.334983:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.335004:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.335013:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.335047:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181475.335102:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+31:2394:x1876092385308544:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 227us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181475.335109:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00010000:00010000:1.0:1789181475.335317:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.335323:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789181475.335431:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789181475.335542:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789181475.335620:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408447360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789181475.335677:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181475.335716:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181475.335795:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408447360 00000100:00100000:3.0:1789181475.335802:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408447360 00000100:00100000:3.0:1789181475.335841:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789181475.335851:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876092408447360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789181475.335937:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876092408447360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.335942:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789181475.336121:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408447360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789181475.336240:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1789181475.336270:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc34fad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408447488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789181475.336288:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181475.336304:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181475.336332:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408447488 00000100:00100000:0.0:1789181475.336339:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408447488 00000100:00100000:0.0:1789181475.336388:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789181475.336397:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1876092408447488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789181475.336956:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1876092408447488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 558us (664us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789181475.336965:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789181475.337115:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc34fad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408447488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789181475.337158:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1789181475.337190:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.337199:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.337204:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.337221:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181475.337225:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.337230:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.337242:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6a00) 00010000:00010000:1.0:1789181475.337243:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789181475.337247:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.337251:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517aa0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789181475.337324:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789181475.337370:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789181475.337379:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 431324655430ns, next at 432324653283ns, rc = 0 00000001:00080000:1.0:1789181475.337384:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1789181475.337398:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6a00) 00010000:00010000:1.0:1789181475.337399:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789181475.337405:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517a8b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80f0 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181475.337507:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd13d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+34:12229:x1876092385308416:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 7531us (7727us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789181475.337515:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000020:00080000:1.0:1789181475.337519:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789181475.339791:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.339896:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385308672 00000100:00100000:3.0:1789181475.339908:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385308672 00000100:00100000:3.0:1789181475.339967:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:3.0:1789181475.339976:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+34:12229:x1876092385308672:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181475.340013:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181475.340037:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517aa7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.340091:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80f7 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.340103:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80f7 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.340121:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:3.0:1789181475.340125:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181475.340129:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f400, rc 0) 00000100:00100000:3.0:1789181475.340189:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:12229:x1876092385308672:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 214us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.340196:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:2.0:1789181475.343593:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181475.343767:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385308928 00000100:00100000:0.0:1789181475.343785:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385308928 00000100:00100000:0.0:1789181475.343836:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:0.0:1789181475.343845:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:12229:x1876092385308928:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1789181475.344359:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+36:12229:x1876092385308928:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 514us (773us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789181475.344365:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00010000:00010000:3.0:1789181475.404018:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181475.406333:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.406414:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385309184 00000100:00100000:3.0:1789181475.406424:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385309184 00000100:00100000:3.0:1789181475.406490:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:3.0:1789181475.406514:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+36:12239:x1876092385309184:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181475.406539:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181475.406559:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517aae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df80fe expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181475.406653:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789181475.406821:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517aae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80fe expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.406835:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dd8258700) 00010000:00010000:3.0:1789181475.406838:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181475.406843:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517aae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80fe expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.406857:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e000, rc 0) 00000100:00100000:3.0:1789181475.406922:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:12239:x1876092385309184:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 409us (597us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1789181475.406930:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:1.0:1789181475.411110:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.412953:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385309312 00000100:00100000:3.0:1789181475.412970:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385309312 00000100:00100000:3.0:1789181475.413088:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1789181475.413099:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc34f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:12239:x1876092385309312:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1789181475.413179:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517abc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413199:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517abc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413230:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517abc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413239:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517ac3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413244:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413247:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413312:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413316:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413320:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181475.413357:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413367:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517abc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413373:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517abc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413378:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517abc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413389:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ee00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181475.413392:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517abc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413397:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517abc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413406:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:3.0:1789181475.413409:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181475.413412:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517abc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413427:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517abc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413436:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413440:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413443:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413446:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fe00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181475.413448:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413451:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413467:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6800) 00010000:00010000:3.0:1789181475.413469:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181475.413472:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517ac3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413476:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517ac3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413482:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413485:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413489:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413494:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658ba00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181475.413498:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413503:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413510:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:3.0:1789181475.413512:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181475.413514:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.413519:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ba00/0x76fb555283517aca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181475.413602:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc34f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:12239:x1876092385309312:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 504us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.413621:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:2.0:1789181475.415884:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181475.415968:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385309568 00000100:00100000:1.0:1789181475.415976:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385309568 00000100:00100000:1.0:1789181475.416076:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:1.0:1789181475.416087:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:12239:x1876092385309568:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1789181475.416314:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:12239:x1876092385309568:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 229us (438us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789181475.416322:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1789181475.439357:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.439408:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385309824 00000100:00100000:3.0:1789181475.439424:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385309824 00000100:00100000:3.0:1789181475.439711:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1789181475.439758:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:12242:x1876092385309824:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181475.439969:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181475.440055:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ad1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8105 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440125:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517ad8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440158:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440171:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440182:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517adf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440187:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440191:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440279:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440285:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440289:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181475.440295:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789181475.440358:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440364:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517ad8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440368:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440378:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181475.440382:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440387:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517ad8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440397:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:2.0:1789181475.440399:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181475.440403:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517ad8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440407:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517ad8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440418:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440424:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517adf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440429:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517adf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440434:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084be00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181475.440436:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517adf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440441:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517adf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440458:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6800) 00010000:00010000:2.0:1789181475.440577:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181475.440581:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517adf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440586:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517adf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440620:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ad1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8105 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440634:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8105 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181475.440641:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:2.0:1789181475.440644:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181475.440646:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a800, rc 0) 00000100:00100000:2.0:1789181475.440758:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+40:12242:x1876092385309824:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1036us (1410us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789181475.440767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1789181475.443048:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181475.443410:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385309952 00000100:00100000:1.0:1789181475.443420:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385309952 00000100:00100000:1.0:1789181475.443713:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:1.0:1789181475.443752:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+40:12242:x1876092385309952:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1789181475.443824:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517af4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.443839:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.443848:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.443881:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.443888:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517af4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.443895:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517af4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.443921:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181475.443925:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517af4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.443931:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517af4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.443941:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181475.443944:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181475.443947:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517af4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.443952:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517af4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181475.444021:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+40:12242:x1876092385309952:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 301us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181475.444027:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:2.0:1789181475.446231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181475.446299:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385310208 00000100:00100000:0.0:1789181475.446306:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385310208 00000100:00100000:0.0:1789181475.446365:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:0.0:1789181475.446374:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+40:12242:x1876092385310208:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1789181475.446716:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+41:12242:x1876092385310208:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 342us (491us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789181475.446746:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1789181475.596450:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408447616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181475.596526:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181475.596667:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408447616 00000100:00100000:0.0:1789181475.596675:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408447616 00000100:00100000:0.0:1789181475.596753:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789181475.596763:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408447616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181475.596791:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408447872:0@lo:400:kworker.0 00002000:00000024:0.0:1789181475.596793:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789181475.596824:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181475.596834:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408447616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181475.596841:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789181475.596850:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408448384:0@lo:400:kworker.0 00000100:00100000:1.0:1789181475.596872:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181475.596879:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408448000:0@lo:400:kworker.0 00000100:00100000:1.0:1789181475.596888:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408448896:0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.596902:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181475.596908:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181475.596921:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408448512:0@lo:400:kworker.0 00000100:00100000:1.0:1789181475.596937:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408448896 00000100:00100000:1.0:1789181475.596940:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408448896 00000100:00100000:0.0:1789181475.596942:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181475.596966:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408447744:0@lo:400:kworker.0 00000100:00100000:1.0:1789181475.596969:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408448512 00000100:00100000:1.0:1789181475.596971:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408448512 00000100:00100000:0.0:1789181475.596996:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181475.597011:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789181475.597013:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408448256:0@lo:400:kworker.0 00000100:00100000:1.0:1789181475.597017:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408448896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.597034:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181475.597048:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408448896:12345-0@lo:400:kworker.0 Request processed in 32us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181475.597049:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408448768:0@lo:400:kworker.0 00000100:00100000:1.0:1789181475.597055:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789181475.597068:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789181475.597070:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181475.597074:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408448512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.597081:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789181475.597086:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408448128:0@lo:400:kworker.0 00000100:00100000:1.0:1789181475.597104:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408448512:12345-0@lo:400:kworker.0 Request processed in 31us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181475.597109:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789181475.597115:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789181475.597174:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181475.597189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408447744 00000100:00100000:3.0:1789181475.597193:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408447744 00000100:00100000:3.0:1789181475.597226:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789181475.597232:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408447744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181475.597268:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408447744:12345-0@lo:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.597273:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789181475.597318:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789181475.597324:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1dc2f05880, transno 4294967313 00000100:00100000:3.0:1789181475.597341:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408447616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181475.597470:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408447872 00000100:00100000:3.0:1789181475.597479:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408447872 00000100:00100000:3.0:1789181475.597498:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408448384 00000100:00100000:3.0:1789181475.597501:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408448384 00000100:00100000:3.0:1789181475.597531:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408448000 00000100:00100000:3.0:1789181475.597534:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408448000 00000100:00100000:3.0:1789181475.597545:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408448256 00000100:00100000:3.0:1789181475.597547:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408448256 00000100:00100000:3.0:1789181475.597560:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408448768 00000100:00100000:3.0:1789181475.597563:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408448768 00000100:00100000:3.0:1789181475.597577:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789181475.597583:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408447872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181475.597617:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408447872:12345-0@lo:400:kworker.0 Request processed in 34us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.597622:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789181475.597633:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789181475.597639:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408448384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181475.597677:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408448384:12345-0@lo:400:kworker.0 Request processed in 39us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.597683:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789181475.597695:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789181475.597700:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408448000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181475.597746:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408448000:12345-0@lo:400:kworker.0 Request processed in 46us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.597751:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789181475.597762:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1789181475.597768:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408448256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181475.597796:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408448256:12345-0@lo:400:kworker.0 Request processed in 28us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.597800:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1789181475.597810:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789181475.597823:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408448768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181475.597851:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408448768:12345-0@lo:400:kworker.0 Request processed in 29us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181475.597855:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00080000:3.0:1789181475.597871:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181475.597874:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181475.598666:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408448640:0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.598706:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181475.598754:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408447744:0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.598768:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408448256:0@lo:400:kworker.0 00010000:00080000:0.0:1789181475.598782:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3955f80 x1876092408448768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181475.598792:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408448768:0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.598828:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408448640 00000100:00100000:0.0:1789181475.598834:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408448640 00000100:00100000:0.0:1789181475.598879:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789181475.598887:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408448640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.598927:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408448640:12345-0@lo:400:kworker.0 Request processed in 41us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181475.598934:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:0.0:1789181475.598951:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181475.598967:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408448640:0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.599010:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408447872:0@lo:400:kworker.0 00010000:00080000:0.0:1789181475.599023:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3955c00 x1876092408448384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181475.599031:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408448384:0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.599041:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408448896:0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.599070:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181475.599076:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408449024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181475.599105:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181475.599131:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408449024 00000100:00100000:0.0:1789181475.599135:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408449024 00000100:00100000:0.0:1789181475.599159:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789181475.599162:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408448128 00000100:00100000:0.0:1789181475.599165:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408449024:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181475.599166:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408448128 00002000:00000024:0.0:1789181475.599180:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789181475.599193:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789181475.599200:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408448128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.599212:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408449024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181475.599217:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789181475.599263:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408449024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181475.599302:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408448128:12345-0@lo:400:kworker.0 Request processed in 41us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181475.599310:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789181475.599313:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408448000:0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.599325:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408448512:0@lo:400:kworker.0 00000100:00100000:1.0:1789181475.599336:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408448128:0@lo:400:kworker.0 00000100:00100000:0.0:1789181475.722141:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181475.722342:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385310464 00000100:00100000:3.0:1789181475.722353:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385310464 00000100:00100000:3.0:1789181475.722425:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:3.0:1789181475.722437:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+41:12273:x1876092385310464:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:3.0:1789181475.722462:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181475.722482:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517afb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df810c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.722602:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517b02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.722620:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517b02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.722632:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517b02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181475.722644:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789181475.722796:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517afb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df810c expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.722816:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517b02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df810c expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.722845:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:3.0:1789181475.722848:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181475.722853:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fe00, rc 0) 00000100:00100000:3.0:1789181475.723642:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:12273:x1876092385310464:12345-192.168.202.1@tcp:101:cat.0 Request processed in 1203us (1508us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789181475.723660:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:2.0:1789181475.734109:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181475.734907:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385310720 00000100:00100000:1.0:1789181475.734920:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385310720 00000100:00100000:1.0:1789181475.734990:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1789181475.735003:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:12273:x1876092385310720:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1789181475.735300:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+44:12273:x1876092385310720:12345-192.168.202.1@tcp:35:cat.0 Request processed in 294us (1194us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1789181475.735310:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:2.0:1789181475.751168:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181475.751986:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385310848 00000100:00100000:0.0:1789181475.752001:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385310848 00000100:00100000:0.0:1789181475.752089:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1789181475.752100:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+44:2393:x1876092385310848:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181475.752119:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181475.752148:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fe00/0x76fb555283517b02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df810c expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.752168:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181475.752174:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181475.753249:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:2393:x1876092385310848:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 1143us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181475.753263:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:3.0:1789181475.821206:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181475.821387:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385311104 00000100:00100000:0.0:1789181475.821398:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385311104 00000100:00100000:0.0:1789181475.821526:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:0.0:1789181475.821553:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:12279:x1876092385311104:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1789181475.821583:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181475.821587:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789181475.821621:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517a68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80e2 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.821644:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:0.0:1789181475.821650:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181475.821677:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517b10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8113 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.821845:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.821873:0:9021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8105 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.821883:0:9021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.821919:0:9021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8105 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.821953:0:9021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8105 expref: 43 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181475.821969:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408449152:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181475.822182:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181475.829643:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181475.829764:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408449152:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181475.829791:0:9021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181475.829833:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385311232 00000100:00100000:3.0:1789181475.829841:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385311232 00010000:00010000:3.0:1789181475.829896:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8105 expref: 44 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181475.829977:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:3.0:1789181475.829987:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+44:2393:x1876092385311232:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181475.830013:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181475.830021:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8105 expref: 44 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.830033:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8105 expref: 44 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.830058:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517ae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8105 expref: 44 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.830078:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:3.0:1789181475.830097:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.830119:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.830127:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181475.830158:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181475.830212:0:9021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181475.830216:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:2393:x1876092385311232:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 231us (583us total) trans 0 rc 0/0 00010000:00010000:0.0:1789181475.830221:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181475.830224:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00000004:00200000:0.0:1789181475.830240:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789181475.830537:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517b10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8113 expref: 44 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.830554:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8113 expref: 43 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.830563:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181475.830566:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789181475.830568:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0800, rc 0) 00000100:00100000:0.0:1789181475.830605:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:12279:x1876092385311104:12345-192.168.202.1@tcp:101:dd.0 Request processed in 9069us (9411us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789181475.830623:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:2.0:1789181475.838292:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181475.838404:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385311360 00000100:00100000:0.0:1789181475.838414:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385311360 00000100:00100000:0.0:1789181475.838470:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:0.0:1789181475.838478:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:12279:x1876092385311360:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1789181475.838502:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181475.838527:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517b25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df811a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.838572:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.838584:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.838594:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.838759:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517b25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df811a expref: 45 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.838778:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df811a expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181475.838786:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181475.838788:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789181475.838790:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1800, rc 0) 00000100:00100000:0.0:1789181475.838836:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+44:12279:x1876092385311360:12345-192.168.202.1@tcp:101:dd.0 Request processed in 359us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181475.838846:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:2.0:1789181475.841644:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181475.842042:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385311616 00000100:00100000:1.0:1789181475.842054:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385311616 00000100:00100000:1.0:1789181475.842142:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:1.0:1789181475.842154:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+44:12279:x1876092385311616:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:1.0:1789181475.842419:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.842437:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.842448:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789181475.842494:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1789181475.842516:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8f14014 reply state 000000009331f642 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.842530:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181475.842537:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181475.842540:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789181475.842544:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789181475.842641:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+47:12279:x1876092385311616:12345-192.168.202.1@tcp:36:dd.0 Request processed in 489us (1006us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789181475.842649:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 169 00000020:00080000:1.0:1789181475.842662:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789181476.114051:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.118460:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385311744 00000100:00100000:0.0:1789181476.118481:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385311744 00000100:00100000:0.0:1789181476.118645:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:0.0:1789181476.118668:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+47:12293:x1876092385311744:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:0.0:1789181476.118695:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181476.118718:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517b3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8121 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118803:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517b41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118815:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517b41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118825:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517b41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118831:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517b48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118836:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517b48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118839:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517b48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118918:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118943:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8113 expref: 48 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118949:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118977:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8113 expref: 48 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.118997:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8113 expref: 48 pid: 9021 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181476.119011:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408449280:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181476.119115:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181476.128917:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181476.129070:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385312000 00000100:00100000:1.0:1789181476.129083:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385312000 00000100:00100000:1.0:1789181476.129162:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:1.0:1789181476.129182:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+49:6166:x1876092385312000:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789181476.129505:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+50:6166:x1876092385312000:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 327us (597us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789181476.129513:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:0.0:1789181476.132875:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408449280:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181476.132909:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181476.133086:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181476.133165:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385312128 00000100:00100000:3.0:1789181476.133174:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385312128 00010000:00010000:3.0:1789181476.133215:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8113 expref: 50 pid: 9021 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181476.133256:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 83 00000100:00100000:3.0:1789181476.133266:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+50:2393:x1876092385312128:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181476.133283:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181476.133289:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8113 expref: 50 pid: 9021 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181476.133301:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8113 expref: 50 pid: 9021 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181476.133338:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517b17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8113 expref: 50 pid: 9021 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181476.133376:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:3.0:1789181476.133381:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181476.133391:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181476.133400:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181476.133434:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181476.133486:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+49:2393:x1876092385312128:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 221us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181476.133493:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 83 00010000:00010000:1.0:1789181476.137491:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137509:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181476.137569:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789181476.137574:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181476.137596:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137612:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137622:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517b41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137629:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517b41 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137636:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517b41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137642:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181476.137646:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517b41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137692:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517b41 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137706:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:1.0:1789181476.137709:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181476.137713:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517b41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137718:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517b41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137756:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517b48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137760:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517b48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137764:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517b48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.137766:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181476.137768:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517b48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.138168:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517b48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.138176:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6800) 00010000:00010000:1.0:1789181476.138179:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181476.138181:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517b48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.138198:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517b48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.138241:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517b3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8121 expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.138256:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8121 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.138263:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181476.138265:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181476.138268:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1a00, rc 0) 00000100:00100000:1.0:1789181476.138367:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+48:12293:x1876092385311744:12345-192.168.202.1@tcp:101:stat.0 Request processed in 19701us (24324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181476.138377:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:2.0:1789181476.185821:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.185895:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385312384 00000100:00100000:0.0:1789181476.185906:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385312384 00000100:00100000:0.0:1789181476.185965:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 171 00000100:00100000:0.0:1789181476.185973:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+48:12299:x1876092385312384:12345-192.168.202.1@tcp:36:truncate.0 00010000:00010000:0.0:1789181476.186031:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181476.186058:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8121 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.186089:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181476.186093:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181476.186249:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.186260:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.186267:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181476.186296:0:9021:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1789181476.186315:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091593b00 reply state 000000000f3c18e2 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.186327:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.186333:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181476.186336:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181476.186338:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181476.186427:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+50:12299:x1876092385312384:12345-192.168.202.1@tcp:36:truncate.0 Request processed in 454us (613us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789181476.186433:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 171 00000020:00080000:0.0:1789181476.186437:0:9021:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789181476.341566:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.341783:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385312512 00000100:00100000:0.0:1789181476.341794:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385312512 00000100:00100000:0.0:1789181476.341858:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:0.0:1789181476.341870:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+50:12313:x1876092385312512:12345-192.168.202.1@tcp:101:stat.0 00010000:00010000:0.0:1789181476.341912:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181476.341930:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8128 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.341985:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517b64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342000:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517b64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342010:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517b64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342021:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517b6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342028:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517b6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342035:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517b6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342103:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342113:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342119:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181476.342159:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789181476.342169:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181476.342193:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342206:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342215:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517b64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342221:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517b64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342226:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517b64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342230:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181476.342233:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517b64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342238:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517b64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342247:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:0.0:1789181476.342249:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181476.342252:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517b64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342257:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517b64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342265:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517b6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342275:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517b6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342279:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517b6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342282:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181476.342283:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517b6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342375:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517b6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342381:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6800) 00010000:00010000:0.0:1789181476.342382:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181476.342384:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517b6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342387:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517b6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342407:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8128 expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342415:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8128 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.342420:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181476.342421:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181476.342427:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0000, rc 0) 00000100:00100000:0.0:1789181476.342487:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+51:12313:x1876092385312512:12345-192.168.202.1@tcp:101:stat.0 Request processed in 619us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181476.342495:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00010000:00010000:1.0:1789181476.430948:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181476.456868:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.456960:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385312768 00000100:00100000:0.0:1789181476.456971:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385312768 00000100:00100000:0.0:1789181476.457033:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:0.0:1789181476.457044:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+51:12323:x1876092385312768:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181476.457067:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181476.457088:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df812f expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181476.457186:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789181476.457296:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df812f expref: 53 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.457309:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dd8258700) 00010000:00010000:0.0:1789181476.457311:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181476.457316:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df812f expref: 53 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.457331:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1a00, rc 0) 00000100:00100000:0.0:1789181476.457391:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+52:12323:x1876092385312768:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 350us (669us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1789181476.457397:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:2.0:1789181476.463090:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181476.467141:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385313024 00000100:00100000:1.0:1789181476.467157:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385313024 00000100:00100000:1.0:1789181476.467237:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1789181476.467250:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd13d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+52:12323:x1876092385313024:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1789181476.470129:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd13d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+53:12323:x1876092385313024:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 2869us (7036us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789181476.470146:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1789181476.553034:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.554010:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385313280 00000100:00100000:0.0:1789181476.554024:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385313280 00000100:00100000:1.0:1789181476.554213:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:1.0:1789181476.554228:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+53:12329:x1876092385313280:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181476.554276:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181476.554436:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517b87 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8136 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.554553:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.554570:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8128 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.554580:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.554776:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8128 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.554791:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8128 expref: 54 pid: 6521 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181476.554803:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd136c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408449408:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181476.555557:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789181476.590361:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd136c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1876092408449408:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181476.590396:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181476.591213:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181476.591296:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385313408 00000100:00100000:2.0:1789181476.591306:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385313408 00010000:00010000:2.0:1789181476.591355:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8128 expref: 55 pid: 6521 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181476.591391:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1789181476.591402:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+55:2393:x1876092385313408:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181476.591417:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181476.591423:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8128 expref: 55 pid: 6521 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181476.591436:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8128 expref: 55 pid: 6521 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181476.591455:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517b72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8128 expref: 55 pid: 6521 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181476.591472:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:2.0:1789181476.591477:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181476.591488:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181476.591497:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181476.591589:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181476.591658:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:2393:x1876092385313408:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 257us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181476.591665:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00010000:00010000:1.0:1789181476.597610:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.597629:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181476.597704:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789181476.598056:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517b87 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8136 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.598079:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8136 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.598087:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181476.598090:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789181476.598569:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13800, rc 0) 00000100:00100000:1.0:1789181476.598752:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:12329:x1876092385313280:12345-192.168.202.1@tcp:101:bash.0 Request processed in 44526us (45726us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789181476.598761:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 174 00000100:00100000:3.0:1789181476.618870:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.619010:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385313664 00000100:00100000:0.0:1789181476.619033:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385313664 00000100:00100000:0.0:1789181476.619099:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 175 00000100:00100000:0.0:1789181476.619111:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:12329:x1876092385313664:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:0.0:1789181476.619339:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.619357:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.619369:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181476.619414:0:9021:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1789181476.619436:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001efb6a1 reply state 000000007a92631d transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.619449:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.619457:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181476.619460:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181476.619464:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181476.619561:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:12329:x1876092385313664:12345-192.168.202.1@tcp:36:bash.0 Request processed in 452us (713us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1789181476.619569:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 175 00000020:00080000:0.0:1789181476.619574:0:9021:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789181476.629829:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.630163:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385313792 00000100:00100000:0.0:1789181476.630175:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385313792 00000100:00100000:0.0:1789181476.630243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:0.0:1789181476.630254:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:12329:x1876092385313792:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1789181476.630278:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181476.630339:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517ba3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df813d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.630435:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.630451:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8136 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.630462:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.630497:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8136 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.630512:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8136 expref: 58 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181476.630526:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408449536:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181476.630635:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181476.634085:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3957800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408449536:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181476.634119:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181476.636700:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.637071:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385313920 00000100:00100000:0.0:1789181476.637081:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385313920 00010000:00010000:0.0:1789181476.637121:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8136 expref: 59 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181476.637167:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:0.0:1789181476.637190:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:2393:x1876092385313920:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181476.637206:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181476.637213:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8136 expref: 59 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.637226:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8136 expref: 59 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.637248:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517b8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8136 expref: 59 pid: 6523 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.637266:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181476.637271:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.637281:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.637289:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.637321:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181476.637388:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:2393:x1876092385313920:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 198us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181476.637395:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00010000:00010000:3.0:1789181476.638272:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181476.638283:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181476.638347:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789181476.638352:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181476.638373:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181476.638428:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517ba3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df813d expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181476.638445:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df813d expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181476.638453:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:3.0:1789181476.638456:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181476.638459:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0400, rc 0) 00000100:00100000:3.0:1789181476.639050:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:12329:x1876092385313792:12345-192.168.202.1@tcp:101:bash.0 Request processed in 8795us (9232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181476.639058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 176 00000100:00100000:3.0:1789181476.650104:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.650273:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385314176 00000100:00100000:0.0:1789181476.650283:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385314176 00000100:00100000:0.0:1789181476.650361:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:0.0:1789181476.650371:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+57:12329:x1876092385314176:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:0.0:1789181476.650995:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:12329:x1876092385314176:12345-192.168.202.1@tcp:35:bash.0 Request processed in 623us (897us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789181476.651005:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:1.0:1789181476.795444:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.795572:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385314432 00000100:00100000:0.0:1789181476.795584:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385314432 00000100:00100000:0.0:1789181476.795665:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:0.0:1789181476.795677:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:12339:x1876092385314432:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181476.795703:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181476.795773:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8144 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181476.795913:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789181476.796013:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517bb1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8144 expref: 60 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.796030:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dd8258700) 00010000:00010000:0.0:1789181476.796033:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181476.796038:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8144 expref: 60 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.796053:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1e00, rc 0) 00000100:00100000:0.0:1789181476.796121:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:12339:x1876092385314432:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 447us (688us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1789181476.796129:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 177 00000100:00100000:3.0:1789181476.801889:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181476.802054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385314560 00000100:00100000:1.0:1789181476.802066:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385314560 00000100:00100000:1.0:1789181476.802126:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:1.0:1789181476.802136:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:12339:x1876092385314560:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1789181476.802210:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517bbf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802228:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517bbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802239:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517bbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802250:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517bc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802271:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802278:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802357:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802365:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802372:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181476.802436:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802449:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517bbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802456:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517bbf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802618:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517bbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802625:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181476.802629:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517bbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802638:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517bbf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802667:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:1.0:1789181476.802670:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181476.802675:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517bbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802682:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517bbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802695:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802701:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802708:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802714:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181476.802717:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.802997:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.803010:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6800) 00010000:00010000:1.0:1789181476.803012:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181476.803015:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517bc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.803020:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517bc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.803041:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.803047:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.803051:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.803056:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181476.803060:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.803066:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.803073:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181476.803076:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181476.803078:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.803083:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181476.803187:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:12339:x1876092385314560:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1050us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181476.803196:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 178 00000100:00100000:3.0:1789181476.806263:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181476.806734:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385314816 00000100:00100000:1.0:1789181476.806747:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385314816 00000100:00100000:1.0:1789181476.806813:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1789181476.806841:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:12339:x1876092385314816:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1789181476.807350:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:12339:x1876092385314816:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 511us (1095us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789181476.807360:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1789181476.868319:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.868426:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385315072 00000100:00100000:0.0:1789181476.868437:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385315072 00000100:00100000:0.0:1789181476.868509:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:0.0:1789181476.868547:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:12342:x1876092385315072:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181476.868576:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181476.868598:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517bd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df814b expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.868710:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517bdb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.868751:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517bdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.868764:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517bdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.868777:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517be2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.868784:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.868790:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.868910:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517be9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.868920:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517be9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.868927:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517be9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181476.868948:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789181476.869029:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517bdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869037:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517bdb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869044:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517bdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869050:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181476.869054:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517bdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869077:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517bdb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869089:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:0.0:1789181476.869092:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181476.869099:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517bdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869106:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517bdb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869119:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869125:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517be2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869141:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517be2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869146:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181476.869149:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517be2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869156:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517be2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869164:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6800) 00010000:00010000:0.0:1789181476.869167:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181476.869170:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517be2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869175:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517be2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869211:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517bd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df814b expref: 63 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869224:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517be9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df814b expref: 62 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.869232:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181476.869234:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181476.869236:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1200, rc 0) 00000100:00100000:0.0:1789181476.869305:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:12342:x1876092385315072:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 769us (994us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789181476.869321:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 179 00000100:00100000:3.0:1789181476.875227:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181476.875263:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.875442:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385315200 00000100:00100000:0.0:1789181476.875452:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385315200 00000100:00100000:0.0:1789181476.875507:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:0.0:1789181476.875517:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:12342:x1876092385315200:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1789181476.875583:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517bf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.875601:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.875612:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.875654:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.875662:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517bf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.875669:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.875675:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181476.875680:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.875688:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181476.875693:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385315328 00000100:00100000:1.0:1789181476.875697:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385315328 00010000:00010000:0.0:1789181476.875699:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181476.875714:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181476.875720:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517bf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181476.875742:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517bf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181476.875747:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1789181476.875754:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff906680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:2393:x1876092385315328:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181476.875766:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181476.875780:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517be9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df814b expref: 63 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181476.875791:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181476.875794:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181476.875813:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff906680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:2393:x1876092385315328:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 59us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181476.875813:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:12342:x1876092385315200:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 297us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181476.875821:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1789181476.875821:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 180 00000100:00100000:3.0:1789181476.878683:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181476.878949:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385315584 00000100:00100000:0.0:1789181476.878961:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385315584 00000100:00100000:0.0:1789181476.879024:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1789181476.879035:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+61:12342:x1876092385315584:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1789181476.879263:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:12342:x1876092385315584:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 228us (590us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789181476.879271:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1789181477.132166:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.132261:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385315840 00000100:00100000:1.0:1789181477.132272:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385315840 00000100:00100000:1.0:1789181477.132366:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00100000:1.0:1789181477.132377:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+62:12360:x1876092385315840:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:1.0:1789181477.132415:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181477.132437:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8152 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.132566:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517c05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.132597:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517c05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.132612:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517c05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181477.132624:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789181477.132763:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517bfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8152 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.132782:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517c05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8152 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.132791:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181477.132793:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789181477.132797:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12c00, rc 0) 00000100:00100000:1.0:1789181477.132851:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:12360:x1876092385315840:12345-192.168.202.1@tcp:101:cat.0 Request processed in 477us (695us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789181477.132858:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 181 00000100:00080000:0.0:1789181477.132989:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181477.167912:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.167978:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385315968 00000100:00100000:0.0:1789181477.167988:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385315968 00000100:00100000:0.0:1789181477.168052:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:0.0:1789181477.168064:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:12361:x1876092385315968:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181477.168091:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181477.168116:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8159 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.168187:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517c1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.168231:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517c1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.168244:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517c1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181477.168286:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789181477.168289:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181477.168308:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517c1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.168345:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8159 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.168363:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517c1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8159 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.168372:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:0.0:1789181477.168375:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181477.168379:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1e00, rc 0) 00000100:00100000:0.0:1789181477.168444:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12361:x1876092385315968:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 382us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181477.168452:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 182 00000100:00100000:3.0:1789181477.173342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.173433:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385316352 00000100:00100000:0.0:1789181477.173443:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385316352 00000100:00100000:0.0:1789181477.173565:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:0.0:1789181477.173576:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12361:x1876092385316352:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1789181477.173927:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12361:x1876092385316352:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 352us (594us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789181477.173948:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:3.0:1789181477.177012:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.177226:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385316480 00000100:00100000:1.0:1789181477.177236:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385316480 00000100:00100000:1.0:1789181477.177304:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:1.0:1789181477.177315:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12361:x1876092385316480:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:1.0:1789181477.177341:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789181477.177369:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517baa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df813d expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.177431:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517c05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8152 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.177445:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517aa7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80f7 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.177456:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181477.177461:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181477.177582:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:12361:x1876092385316480:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 269us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181477.177590:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1789181477.182250:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.182444:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385316608 00000100:00100000:0.0:1789181477.182455:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385316608 00000100:00100000:0.0:1789181477.182551:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:0.0:1789181477.182564:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:12361:x1876092385316608:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:0.0:1789181477.182704:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c21 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.182760:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.182776:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789181477.182891:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789181477.182980:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:12361:x1876092385316608:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 418us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181477.182988:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 183 00000100:00100000:3.0:1789181477.211897:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.213376:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385316736 00000100:00100000:0.0:1789181477.213390:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385316736 00000100:00100000:0.0:1789181477.214355:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 184 00000100:00100000:0.0:1789181477.214369:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:12363:x1876092385316736:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181477.214390:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181477.214419:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517c28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8160 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214507:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517c2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214551:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517c2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214563:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517c2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214574:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517c36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214581:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517c36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214588:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517c36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214668:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214677:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214684:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181477.214721:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789181477.214750:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181477.214770:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214781:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214799:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517c2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214805:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517c2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214812:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517c2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214818:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181477.214823:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517c2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214832:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517c2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214845:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:0.0:1789181477.214848:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181477.214853:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517c2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214860:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517c2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214872:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517c36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214878:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517c36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214884:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517c36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214895:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181477.214898:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517c36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214904:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517c36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214911:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6800) 00010000:00010000:0.0:1789181477.214913:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181477.214916:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517c36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214921:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517c36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214948:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517c28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8160 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214961:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8160 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.214968:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181477.214971:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181477.214973:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0800, rc 0) 00000100:00100000:0.0:1789181477.215057:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:12363:x1876092385316736:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 691us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181477.215064:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 184 00000040:00080000:2.0:1789181477.262044:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181477.262055:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789181477.262101:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789181477.262111:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181477.262246:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408449664:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789181477.262364:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd930c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789181477.265215:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408449664:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789181477.271303:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.273694:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385316864 00000100:00100000:0.0:1789181477.273736:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385316864 00000100:00100000:2.0:1789181477.274011:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:2.0:1789181477.274023:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:12375:x1876092385316864:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789181477.274056:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789181477.274184:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:12375:x1876092385316864:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 162us (2894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181477.274191:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 185 00000100:00100000:0.0:1789181477.277124:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.277339:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385316992 00000100:00100000:1.0:1789181477.277349:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385316992 00000100:00100000:1.0:1789181477.277563:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:1.0:1789181477.277574:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:12375:x1876092385316992:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789181477.277658:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c44 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.277676:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.277688:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.277703:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.277711:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.277759:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.277895:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.277905:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.277912:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181477.277960:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789181477.277964:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181477.277976:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.277987:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.277993:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c44 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278000:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278007:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.278012:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278020:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c44 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278039:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:1.0:1789181477.278042:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.278047:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278054:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278069:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278075:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c4b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278081:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278086:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.278089:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278094:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c4b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278101:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9c1dc3dc5900) 00010000:00010000:1.0:1789181477.278104:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.278106:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c4b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278111:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278135:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278214:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278285:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278291:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.278295:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278302:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278310:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181477.278313:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.278316:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.278323:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181477.278472:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:12375:x1876092385316992:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 886us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181477.278481:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 186 00000100:00100000:1.0:1789181477.281982:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181477.282058:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385317248 00000100:00100000:3.0:1789181477.282083:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385317248 00000100:00100000:3.0:1789181477.282149:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:3.0:1789181477.282160:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:12375:x1876092385317248:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181477.282181:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181477.282201:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517c59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8167 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.282306:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.282321:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.282421:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181477.282434:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789181477.282889:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.282899:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.282906:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.282913:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181477.282917:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.282924:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.282947:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:3.0:1789181477.282950:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181477.282956:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.282962:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.283004:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517c59 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8167 expref: 66 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.283013:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:3.0:1789181477.283015:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181477.283019:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517c59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8167 expref: 66 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.283027:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085ee00, rc 0) 00000100:00100000:3.0:1789181477.283082:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12375:x1876092385317248:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 924us (1111us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1789181477.283091:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 187 00000100:00100000:1.0:1789181477.293978:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.294032:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385317376 00000100:00100000:0.0:1789181477.294042:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385317376 00000100:00100000:0.0:1789181477.294103:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:0.0:1789181477.294113:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd136dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12375:x1876092385317376:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789181477.294159:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789181477.294275:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd136dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12375:x1876092385317376:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 162us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181477.294283:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 188 00000100:00100000:0.0:1789181477.300824:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181477.300905:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385317632 00000100:00100000:3.0:1789181477.300915:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385317632 00000100:00100000:3.0:1789181477.300976:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:3.0:1789181477.300985:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12375:x1876092385317632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181477.301006:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181477.301009:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789181477.301033:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517c1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8159 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.301064:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:3.0:1789181477.301069:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181477.301081:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517c6e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df816e expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181477.301441:0:9021:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789181477.301665:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517c75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.301679:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.301689:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.301779:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517c6e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df816e expref: 67 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.301793:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517c75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df816e expref: 66 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.301800:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6900) 00010000:00010000:3.0:1789181477.301803:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181477.301806:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e200, rc 0) 00000100:00100000:3.0:1789181477.301883:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12375:x1876092385317632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 885us (1054us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789181477.301892:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 189 00000100:00100000:3.0:1789181477.309115:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.310018:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385317888 00000100:00100000:1.0:1789181477.310047:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385317888 00000100:00100000:1.0:1789181477.310107:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:1.0:1789181477.310117:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12375:x1876092385317888:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789181477.310175:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181477.310202:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517c75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df816e expref: 66 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310758:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6900) 00010000:00010000:1.0:1789181477.310771:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181477.310794:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310809:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310820:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310872:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe6c51e39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310880:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6c51e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310887:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6c51e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310934:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310942:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c83 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310957:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310963:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.310968:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310975:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310984:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:1.0:1789181477.310987:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.310991:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c83 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.310997:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517c83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.311007:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6c51e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.311013:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6c51e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.311018:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6c51e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.311023:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.311026:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6c51e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.311041:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c8a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6c51e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.311049:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe6c51e39 (ffff9c1dc3dc5900) 00010000:00010000:1.0:1789181477.311051:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.311054:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c8a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe6c51e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.311060:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517c8a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe6c51e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181477.311151:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12375:x1876092385317888:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1034us (2046us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181477.311159:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 190 00000100:00100000:3.0:1789181477.323269:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181477.323310:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385318016 00000100:00100000:3.0:1789181477.323319:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385318016 00000100:00100000:3.0:1789181477.323368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:3.0:1789181477.323377:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12375:x1876092385318016:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181477.323396:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181477.323418:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517c91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8175 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.323453:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.323466:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.323478:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.323603:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517c91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8175 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.323621:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8175 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.323630:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:3.0:1789181477.323632:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789181477.323636:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e000, rc 0) 00000100:00100000:3.0:1789181477.323705:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12375:x1876092385318016:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 328us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181477.323719:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 191 00000100:00100000:3.0:1789181477.326822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.327045:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385318272 00000100:00100000:1.0:1789181477.327067:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385318272 00000100:00100000:1.0:1789181477.327147:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:1.0:1789181477.327158:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12375:x1876092385318272:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789181477.327248:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.327265:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.327277:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181477.327452:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789181477.327462:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 433314738209ns, next at 434314735493ns, rc = 0 00000004:00010000:1.0:1789181477.327945:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5621870 reply state 00000000afdafff9 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.327962:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.327970:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:1.0:1789181477.327973:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789181477.327978:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789181477.328663:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:12375:x1876092385318272:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 1500us (1845us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789181477.328674:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 192 00000100:00100000:0.0:1789181477.337438:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181477.337629:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385318400 00000100:00100000:2.0:1789181477.337650:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385318400 00000100:00100000:2.0:1789181477.337715:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:2.0:1789181477.337748:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:12375:x1876092385318400:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181477.337775:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181477.337797:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517ca6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df817c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.337881:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df817c expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.337897:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df817c expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.337918:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:2.0:1789181477.337921:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181477.337925:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b000, rc 0) 00000100:00100000:2.0:1789181477.337981:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+69:12375:x1876092385318400:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 256us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181477.337988:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 193 00000100:00100000:3.0:1789181477.340780:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.342907:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385318528 00000100:00100000:1.0:1789181477.342923:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385318528 00000100:00100000:1.0:1789181477.343007:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:1.0:1789181477.343019:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+6:2393:x1876092385318528:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789181477.343260:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385318528:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 243us (2489us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789181477.343268:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00080000:3.0:1789181477.343506:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181477.351282:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181477.351484:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385318784 00000100:00100000:2.0:1789181477.351494:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385318784 00000100:00100000:2.0:1789181477.351555:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:2.0:1789181477.351566:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+69:12375:x1876092385318784:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789181477.351816:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+70:12375:x1876092385318784:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 251us (543us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789181477.351825:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:1.0:1789181477.359685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181477.359866:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385319040 00000100:00100000:2.0:1789181477.359878:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385319040 00000100:00100000:2.0:1789181477.359946:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:2.0:1789181477.359959:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+70:12375:x1876092385319040:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789181477.360118:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+70:12375:x1876092385319040:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 162us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181477.360149:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 194 00000100:00100000:1.0:1789181477.376563:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181477.376858:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385319168 00000100:00100000:3.0:1789181477.376874:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385319168 00000100:00100000:2.0:1789181477.376997:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:2.0:1789181477.377008:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+70:12375:x1876092385319168:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181477.377029:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181477.377051:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517cad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8183 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.377126:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517cb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.377215:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.377228:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181477.377272:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181477.377291:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.377318:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517cad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8183 expref: 72 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.377333:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8183 expref: 71 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.377342:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:2.0:1789181477.377345:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789181477.377353:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084ac00, rc 0) 00000100:00100000:2.0:1789181477.377519:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+71:12375:x1876092385319168:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 511us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181477.377526:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 195 00000100:00100000:3.0:1789181477.380633:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181477.380703:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385319296 00000100:00100000:2.0:1789181477.380713:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385319296 00000100:00100000:2.0:1789181477.380796:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1789181477.380806:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385319296:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181477.380825:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181477.380845:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb555283517cbb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df818a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181477.380870:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4be25, blocks: 0x0 00010000:00010000:2.0:1789181477.380890:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1789181477.380894:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181477.380903:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb555283517cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df818a expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.380922:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb555283517cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df818a expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.380938:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a000, rc 0) 00000100:00100000:2.0:1789181477.380997:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385319296:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 192us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181477.381005:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:3.0:1789181477.383963:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.384092:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385319552 00000100:00100000:0.0:1789181477.384102:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385319552 00000100:00100000:0.0:1789181477.384171:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:0.0:1789181477.384182:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+71:12375:x1876092385319552:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789181477.384278:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+71:12375:x1876092385319552:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 98us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181477.384285:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 196 00000100:00100000:0.0:1789181477.390932:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181477.391026:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385319680 00000100:00100000:2.0:1789181477.391044:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385319680 00000100:00100000:2.0:1789181477.391134:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:2.0:1789181477.391219:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:12375:x1876092385319680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181477.391238:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181477.391256:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8191 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.391289:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb555283517cbb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df818a expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.391300:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181477.391304:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181477.391310:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.391344:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb555283517cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df818a expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.391359:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb555283517cbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df818a expref: 9 pid: 8435 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181477.391375:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408449792:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181477.391523:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd930c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789181477.394780:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408449792:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181477.394812:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.394831:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a200, rc 0) 00000100:00100000:1.0:1789181477.394924:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:12375:x1876092385319680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 3780us (4000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181477.394932:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:0.0:1789181477.395420:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.395711:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385319808 00000100:00100000:1.0:1789181477.395721:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385319808 00010000:00010000:1.0:1789181477.395782:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb555283517cbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df818a expref: 9 pid: 8435 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181477.395820:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:1.0:1789181477.395831:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2394:x1876092385319808:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181477.395847:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181477.395882:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb555283517cbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df818a expref: 9 pid: 8435 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.395897:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb555283517cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df818a expref: 9 pid: 8435 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.395927:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039978481/0x76fb555283517cbb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df818a expref: 9 pid: 8435 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.395939:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181477.395943:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181477.395952:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.395962:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.396010:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181477.396025:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1876092408449920:192.168.202.1@tcp:105: 00000100:00100000:1.0:1789181477.396088:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181477.402526:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181477.402565:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385319936 00000100:00100000:3.0:1789181477.402574:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385319936 00002000:00100000:3.0:1789181477.402624:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c1cc3ba5180 x1876092385319936/t0(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:608/0 lens 504/0 e 0 to 0 dl 1789181488 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181477.402645:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc3ba5180 with x1876092385319936 ext(0->8) 00002000:00010000:3.0:1789181477.402652:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1cc3ba5180 00000100:00100000:3.0:1789181477.402681:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1789181477.402691:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2394:x1876092385319936:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789181477.402711:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1876092408449920:192.168.202.1@tcp:105: 00010000:00010000:1.0:1789181477.402753:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181477.402804:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2394:x1876092385319808:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 6974us (7386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181477.402813:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:3.0:1789181477.406354:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2394:x1876092385319936:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 3653us (3829us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789181477.406368:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00002000:00100000:3.0:1789181477.406381:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c1cc3ba5180 x1876092385319936/t4294967315(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:608/0 lens 504/448 e 0 to 0 dl 1789181488 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181477.406390:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc3ba5180 with x1876092385319936 ext(0->8) 00002000:00010000:3.0:1789181477.406396:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1cc3ba5180 00000100:00100000:3.0:1789181477.408518:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.410946:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385320064 00000100:00100000:1.0:1789181477.410961:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385320064 00000100:00100000:1.0:1789181477.411069:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 197 00000100:00100000:1.0:1789181477.411082:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+71:12375:x1876092385320064:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789181477.419350:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789181477.419368:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:2.0:1789181477.419427:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789181477.419444:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c1dd00c1540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789181477.419464:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1dfb5c6000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c1dd00c1000 00000020:00080000:2.0:1789181477.419467:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1dfb5c6f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c1cc25b2400 00000020:00080000:2.0:1789181477.419653:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789181477.419703:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789181477.419720:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408450048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789181477.419807:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181477.419842:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181477.419848:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408450176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789181477.419881:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181477.419916:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408450048 00000100:00100000:2.0:1789181477.419923:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408450048 00000100:00100000:2.0:1789181477.419968:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408450176 00000100:00100000:2.0:1789181477.419971:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408450176 00000100:00100000:2.0:1789181477.419993:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789181477.420001:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408450048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789181477.420101:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789181477.420105:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789181477 00002000:00010000:2.0:1789181477.420107:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789181477.420110:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789181477 -> 1789181477 00002000:00010000:2.0:1789181477.420112:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789181477.420259:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420269:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420277:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420283:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.420288:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420304:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420320:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c1dfadc6500) 00010000:00010000:1.0:1789181477.420323:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.420328:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420334:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb5552835179ea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420352:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420359:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420365:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420370:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ea00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.420373:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420378:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420386:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:1.0:1789181477.420388:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.420390:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420406:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb5552835179f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420419:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420425:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420431:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420436:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0030800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.420440:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420445:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420453:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6800) 00010000:00010000:1.0:1789181477.420456:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.420459:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420465:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283517a30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420481:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420486:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420498:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420503:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.420505:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420511:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420519:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181477.420521:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.420524:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420530:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517b33 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420541:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420547:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420553:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420558:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0e00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.420561:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420577:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420585:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181477.420588:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.420591:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420597:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0e00/0x76fb555283517b56 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420609:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420614:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420620:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420624:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.420627:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420633:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420652:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181477.420655:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181477.420657:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420671:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1a00/0x76fb555283517b9c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420683:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420689:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420695:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420700:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.420703:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420708:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420716:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:1.0:1789181477.420718:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789181477.420738:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.420745:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517c9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181477.422743:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408450048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2708us (2901us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789181477.422758:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789181477.422798:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789181477.422813:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408450176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789181477.422847:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1789181477.422896:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4be22, atime: 0x6aa4be23, ctime: 0x6aa4be22, blocks: 0x8 00010000:00010000:2.0:1789181477.422904:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ab9c83d/0x76fb555283517cc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.422921:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1789181477.422926:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181477.422933:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ab9c83d/0x76fb555283517cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.422948:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ab9c83d/0x76fb555283517cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.422958:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ab9c83d/0x76fb555283517cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.422966:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ab9c83d/0x76fb555283517cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.422987:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1789181477.423275:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181477.423281:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181477.423385:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:12375:x1876092385320064:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 12303us (14874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181477.423395:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 197 00010000:00010000:0.0:1789181477.424024:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181477.424035:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ab9c83d/0x76fb555283517cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.424046:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084aa00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181477.424051:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab9c83d/0x76fb555283517cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.424070:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab9c83d/0x76fb555283517cc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.424089:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ab9c83d/0x76fb555283517cc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.424096:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ab9c83d/0x76fb555283517cc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.424117:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181477.424119:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181477.424120:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181477.424427:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3643:x1876092408450176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1618us (4543us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789181477.424437:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1789181477.424493:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1cc37c4a80/2, rc 0, transno 4294967308 00000100:00100000:2.0:1789181477.424500:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408450176:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789181477.424516:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1cc37c5880/2, rc 0, transno 4294967316 00000100:00100000:2.0:1789181477.424520:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408450048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789181477.439215:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181477.441262:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385320192 00000100:00100000:3.0:1789181477.441278:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385320192 00000100:00100000:3.0:1789181477.442060:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:3.0:1789181477.442075:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2393:x1876092385320192:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789181477.452047:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789181477.453522:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1789181477.453538:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1789181477.453679:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385320192:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 11601us (14543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181477.453691:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1789181477.456484:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.456662:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385320448 00000100:00100000:0.0:1789181477.456673:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385320448 00000100:00100000:0.0:1789181477.456776:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:0.0:1789181477.456787:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:12375:x1876092385320448:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789181477.456841:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181477.456868:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517cb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8183 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.456888:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:0.0:1789181477.456893:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181477.456921:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.456934:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.456958:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181477.457070:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa16c644 reply state 000000006ea25227 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.457083:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.457090:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:0.0:1789181477.457093:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789181477.457096:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181477.457187:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:12375:x1876092385320448:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 401us (723us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789181477.457194:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 198 00000100:00100000:3.0:1789181477.463165:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181477.463299:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385320576 00000100:00100000:2.0:1789181477.463311:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385320576 00000100:00100000:2.0:1789181477.463366:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1789181477.463376:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385320576:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789181477.463667:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789181477.463671:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789181477 -> 1789181476 00002000:00010000:2.0:1789181477.463675:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789181475 00002000:00010000:2.0:1789181477.463677:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789181477 -> 1789181476 00002000:00010000:2.0:1789181477.463679:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789181477.464712:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385320576:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 1329us (1550us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789181477.464745:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1789181477.467664:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181477.467816:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385320832 00000100:00100000:3.0:1789181477.467826:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385320832 00000100:00100000:3.0:1789181477.467920:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:3.0:1789181477.467932:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:12375:x1876092385320832:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789181477.467997:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.468014:0:9021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8175 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.468024:0:9021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.468077:0:9021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8175 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.468089:0:9021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8175 expref: 20 pid: 6522 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181477.468102:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408450304:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181477.468198:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181477.471516:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.471790:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385320960 00000100:00100000:1.0:1789181477.471800:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385320960 00010000:00010000:1.0:1789181477.471844:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8175 expref: 21 pid: 6522 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181477.472062:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:1.0:1789181477.472073:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:2394:x1876092385320960:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181477.472089:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181477.472096:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8175 expref: 21 pid: 6522 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.472108:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8175 expref: 21 pid: 6522 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.472130:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:1.0:1789181477.472135:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.472145:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.472152:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.472170:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181477.472224:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:2394:x1876092385320960:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 153us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181477.472232:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00010000:00010000:0.0:1789181477.472936:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517c98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8175 expref: 20 pid: 6522 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181477.472954:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408450304:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181477.472975:0:9021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.472985:0:9021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.472991:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.473030:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.473050:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.473057:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.473064:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181477.473069:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.473078:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.473089:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:0.0:1789181477.473092:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789181477.473096:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.473101:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517cd7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181477.473162:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:12375:x1876092385320832:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 5231us (5505us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789181477.473170:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 199 00000100:00100000:3.0:1789181477.478316:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181477.479440:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385321088 00000100:00100000:2.0:1789181477.479455:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385321088 00000100:00100000:3.0:1789181477.480139:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1789181477.480151:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385321088:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789181477.480194:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.480215:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.480225:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181477.480229:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181477.480234:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.480272:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.480307:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 8 pid: 8437 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181477.480323:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1876092408450432:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181477.480416:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181477.490657:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.490752:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385321216 00000100:00100000:0.0:1789181477.490769:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385321216 00010000:00010000:0.0:1789181477.490807:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 9 pid: 8437 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181477.490841:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 88 00000100:00100000:0.0:1789181477.490867:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385321216:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181477.490894:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181477.490917:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 9 pid: 8437 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.490931:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 9 pid: 8437 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.490956:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181477.490960:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181477.490966:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.490976:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.490996:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181477.491062:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385321216:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 197us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181477.491070:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 88 00010000:00010000:2.0:1789181477.491888:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000504bb7bc/0x76fb555283517cc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8191 expref: 8 pid: 8437 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181477.491909:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1876092408450432:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181477.491932:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.491943:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.491951:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.491992:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.492002:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.492009:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.492016:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fe00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181477.492021:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.492029:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.492044:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.492051:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6c22fff/0x76fb555283517cde lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181477.492121:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385321088:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 11973us (13815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181477.492128:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:3.0:1789181477.494303:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.494797:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385321472 00000100:00100000:0.0:1789181477.494808:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385321472 00000100:00100000:0.0:1789181477.494874:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 200 00000100:00100000:0.0:1789181477.494886:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:12375:x1876092385321472:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789181477.494971:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.495009:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df811a expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.495019:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.495196:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df811a expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.495209:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df811a expref: 19 pid: 6523 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181477.495236:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408450560:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181477.495313:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181477.497348:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181477.497426:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385321600 00000100:00100000:2.0:1789181477.497437:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385321600 00010000:00010000:2.0:1789181477.497488:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df811a expref: 20 pid: 6523 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181477.497547:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 89 00000100:00100000:2.0:1789181477.497558:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:2394:x1876092385321600:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181477.497574:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181477.497580:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df811a expref: 20 pid: 6523 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.497594:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df811a expref: 20 pid: 6523 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.497621:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:2.0:1789181477.497626:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.497646:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.497655:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.497674:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181477.497747:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:2394:x1876092385321600:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 190us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181477.497755:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 89 00010000:00010000:1.0:1789181477.499103:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517b2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df811a expref: 19 pid: 6523 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181477.499121:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408450560:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181477.499138:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.499146:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.499150:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.499867:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.499890:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df817c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.499900:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.499941:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df817c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.499957:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df817c expref: 19 pid: 6522 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181477.499989:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408450688:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181477.500077:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789181477.502437:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408450688:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181477.502468:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181477.504238:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.504405:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385321728 00000100:00100000:1.0:1789181477.504416:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385321728 00010000:00010000:1.0:1789181477.504455:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df817c expref: 20 pid: 6522 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181477.504500:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 90 00000100:00100000:1.0:1789181477.504509:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:2393:x1876092385321728:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181477.504524:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181477.504541:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df817c expref: 20 pid: 6522 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.504555:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df817c expref: 20 pid: 6522 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.504576:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517ca6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df817c expref: 20 pid: 6522 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.504593:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:1.0:1789181477.504599:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.504621:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.504628:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.504670:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181477.504765:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:2393:x1876092385321728:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 256us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181477.504773:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 90 00010000:00010000:2.0:1789181477.505365:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181477.505386:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181477.505503:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789181477.505625:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1789181477.505676:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789181477.505792:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876092408450816:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789181477.505849:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181477.505882:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc11cab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181477.506234:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408450816 00000100:00100000:0.0:1789181477.506250:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408450816 00000100:00100000:0.0:1789181477.506294:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789181477.506303:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876092408450816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789181477.506403:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876092408450816:12345-0@lo:1000:mdt00_000.0 Request processed in 93us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181477.506411:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789181477.507109:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1789181477.507116:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1cc37c5880, transno 4294967316 00000100:00100000:2.0:1789181477.507176:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876092408450816:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789181477.507298:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1789181477.507352:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876092408450944:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789181477.507388:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181477.507423:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd930c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181477.507523:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408450944 00000100:00100000:0.0:1789181477.507528:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408450944 00000100:00100000:0.0:1789181477.507576:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789181477.507584:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1876092408450944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789181477.507708:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876092408450944:12345-0@lo:1000:mdt00_000.0 Request processed in 125us (318us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789181477.507715:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789181477.507960:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1876092408450944:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789181477.508001:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508012:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508020:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508027:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.508031:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508040:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508056:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:1.0:1789181477.508059:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181477.508076:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508082:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13800/0x76fb555283517cec lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508104:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508110:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c21 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508116:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508121:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181477.508124:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508129:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c21 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508136:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:1.0:1789181477.508138:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181477.508140:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c21 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508145:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517c21 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508164:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508177:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8160 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508190:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508215:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8160 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.508228:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8160 expref: 22 pid: 6521 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181477.508239:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408451072:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181477.508313:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789181477.513233:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3973100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1876092408451072:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181477.513261:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181477.513979:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181477.514330:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385321856 00000100:00100000:0.0:1789181477.514340:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385321856 00010000:00010000:0.0:1789181477.514377:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8160 expref: 23 pid: 6521 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181477.514425:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 91 00000100:00100000:0.0:1789181477.514435:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:2394:x1876092385321856:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181477.514476:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181477.514484:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8160 expref: 23 pid: 6521 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.514497:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8160 expref: 23 pid: 6521 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.514519:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517c3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8160 expref: 23 pid: 6521 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.514543:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:0.0:1789181477.514549:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.514559:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.514567:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.514600:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181477.514664:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:2394:x1876092385321856:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 230us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181477.514672:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 91 00010000:00010000:3.0:1789181477.514850:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514859:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514872:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514879:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514886:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514892:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181477.514896:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514914:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514925:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:3.0:1789181477.514927:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181477.514931:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514937:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517cf3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514948:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514954:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514960:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514965:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181477.514967:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514973:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.514981:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6200) 00010000:00010000:3.0:1789181477.514983:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789181477.514986:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181477.515001:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517ce5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181477.515137:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:12375:x1876092385321472:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 20253us (20839us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789181477.515145:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 200 00000020:00080000:3.0:1789181477.515148:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789181477.515229:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181477.515234:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181477.515834:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1789181477.515844:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181477.520064:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181477.532932:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385322112 00000100:00100000:1.0:1789181477.532948:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385322112 00000100:00100000:1.0:1789181477.533018:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:1.0:1789181477.533029:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd13d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:12375:x1876092385322112:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789181477.533296:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789181477.533330:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1789181477.533365:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.533384:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.533414:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.533423:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.533430:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.533436:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181477.533465:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789181477.533562:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd13d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:12375:x1876092385322112:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 535us (13510us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789181477.533571:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000020:00080000:1.0:1789181477.533577:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789181477.533692:0:13192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181477.533701:0:13192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.533719:0:13192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13a00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181477.533751:0:13192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.533769:0:13192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.533783:0:13192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:0.0:1789181477.533786:0:13192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789181477.533791:0:13192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.533796:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13a00/0x76fb555283517cfa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181477.533809:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181477.533810:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181477.533812:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181477.651018:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408451200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181477.651098:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181477.651220:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408451200 00000100:00100000:3.0:1789181477.651229:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408451200 00000100:00100000:3.0:1789181477.651284:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789181477.651293:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408451200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181477.651326:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789181477.651376:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408451200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181477.651382:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789181477.651512:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408451200:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789181478.026400:0:14711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181478.026411:0:14711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181478.026436:0:14711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789181478.026443:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789181478.281929:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181478.284694:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385322368 00000100:00100000:1.0:1789181478.284710:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385322368 00000100:00100000:0.0:1789181478.292001:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:0.0:1789181478.292016:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:12385:x1876092385322368:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181478.292050:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181478.292072:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8198 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.292196:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517d08 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.292239:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517d08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.292257:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517d08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181478.292273:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789181478.292463:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8198 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.292487:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517d08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8198 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.292496:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:0.0:1789181478.292499:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789181478.292503:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0400, rc 0) 00000100:00100000:0.0:1789181478.292657:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:12385:x1876092385322368:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 643us (10736us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789181478.292665:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 201 00000100:00100000:1.0:1789181478.297686:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181478.298100:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385322496 00000100:00100000:1.0:1789181478.298111:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385322496 00000100:00100000:1.0:1789181478.298177:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:1.0:1789181478.298188:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:12385:x1876092385322496:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:1.0:1789181478.298285:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517d16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.298308:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300163:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300190:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517d1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300204:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300211:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300295:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300304:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300312:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181478.300919:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300933:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517d16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300941:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517d16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300948:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517d16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300972:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181478.300977:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517d16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300985:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517d16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.300999:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:1.0:1789181478.301002:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181478.301006:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517d16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301013:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517d16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301026:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517d1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301032:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517d1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301037:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517d1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301042:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181478.301045:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517d1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301050:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517d1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301068:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dc3dc5500) 00010000:00010000:1.0:1789181478.301071:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181478.301074:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517d1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301079:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb555283517d1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301093:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301100:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301105:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301110:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181478.301112:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301118:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301125:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dc3dc5800) 00010000:00010000:1.0:1789181478.301127:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181478.301130:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.301135:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517d24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181478.301246:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:12385:x1876092385322496:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 3056us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181478.301256:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 202 00000100:00100000:0.0:1789181478.375551:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181478.375681:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385322752 00000100:00100000:3.0:1789181478.375691:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385322752 00000100:00100000:3.0:1789181478.375773:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:3.0:1789181478.375783:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+25:12388:x1876092385322752:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181478.375826:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181478.375846:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df819f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.375926:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d32 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.375942:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.375955:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.375970:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.375978:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.375984:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376091:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376099:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376106:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181478.376116:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789181478.376359:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376368:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d32 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376374:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376381:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181478.376385:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376458:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376471:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:3.0:1789181478.376474:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181478.376479:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376485:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376497:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376504:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376511:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376515:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181478.376525:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376531:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376540:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6f00) 00010000:00010000:3.0:1789181478.376543:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181478.376545:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376550:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376591:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df819f expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376605:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df819f expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.376612:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:3.0:1789181478.376614:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181478.376617:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085ea00, rc 0) 00000100:00100000:3.0:1789181478.376699:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:12388:x1876092385322752:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 917us (1158us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789181478.376708:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 203 00000100:00100000:3.0:1789181478.382707:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181478.389158:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385322880 00000100:00100000:0.0:1789181478.389177:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385322880 00000100:00100000:0.0:1789181478.389243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:0.0:1789181478.389255:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:12388:x1876092385322880:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:0.0:1789181478.389324:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.389343:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.389373:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.389516:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.389525:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.389532:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.389538:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181478.389542:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.389548:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.389562:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:0.0:1789181478.389565:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181478.389571:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.389577:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181478.389695:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:12388:x1876092385322880:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 441us (6995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181478.389704:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 204 00000100:00100000:1.0:1789181478.395229:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181478.395433:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385323136 00000100:00100000:2.0:1789181478.395444:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385323136 00000100:00100000:2.0:1789181478.395515:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:2.0:1789181478.395649:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:12388:x1876092385323136:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1789181478.395924:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+28:12388:x1876092385323136:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 397us (715us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1789181478.395933:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:2.0:1789181478.450941:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181478.451045:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385323392 00000100:00100000:0.0:1789181478.451069:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385323392 00000100:00100000:0.0:1789181478.451132:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:0.0:1789181478.451156:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+28:11920:x1876092385323392:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1789181478.451184:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181478.451205:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d55 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81a6 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.451314:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.451330:0:9021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df819f expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.451340:0:9021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.451375:0:9021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df819f expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.451390:0:9021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df819f expref: 29 pid: 6522 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181478.451417:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408451328:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181478.451516:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181478.458257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181478.458345:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385323520 00000100:00100000:1.0:1789181478.458356:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385323520 00010000:00010000:1.0:1789181478.458399:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df819f expref: 30 pid: 6522 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181478.458441:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 92 00000100:00100000:1.0:1789181478.458452:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:2394:x1876092385323520:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181478.458468:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181478.458475:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df819f expref: 30 pid: 6522 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.458489:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df819f expref: 30 pid: 6522 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.458513:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:1.0:1789181478.458519:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.458529:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.458537:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.458575:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181478.458646:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:2394:x1876092385323520:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 195us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181478.458654:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 92 00010000:00010000:2.0:1789181478.458916:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ea00/0x76fb555283517d40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df819f expref: 29 pid: 6522 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181478.458946:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408451328:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181478.458968:0:9021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.458978:0:9021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.458984:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181478.459003:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789181478.459126:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1200/0x76fb555283517d55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81a6 expref: 30 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.459143:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81a6 expref: 29 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.459151:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:2.0:1789181478.459154:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181478.459156:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0800, rc 0) 00000100:00100000:2.0:1789181478.459199:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:11920:x1876092385323392:12345-192.168.202.1@tcp:101:bash.0 Request processed in 8059us (8270us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1789181478.459207:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 205 00000100:00100000:0.0:1789181478.474980:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181478.475069:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385323648 00000100:00100000:1.0:1789181478.475080:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385323648 00000100:00100000:1.0:1789181478.475143:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 206 00000100:00100000:1.0:1789181478.475162:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:11920:x1876092385323648:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181478.475188:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181478.475212:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517d6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.475249:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517d71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.475265:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.475277:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.475414:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13400/0x76fb555283517d6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81ad expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.475434:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517d71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81ad expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.475443:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:1.0:1789181478.475453:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789181478.475458:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13200, rc 0) 00000100:00100000:1.0:1789181478.475526:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:11920:x1876092385323648:12345-192.168.202.1@tcp:101:bash.0 Request processed in 365us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181478.475533:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 206 00010000:00010000:0.0:1789181478.476642:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181478.480215:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181478.480312:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385323904 00000100:00100000:3.0:1789181478.480323:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385323904 00000100:00100000:3.0:1789181478.480385:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 207 00000100:00100000:3.0:1789181478.480412:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:11920:x1876092385323904:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:3.0:1789181478.480662:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.480680:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.480691:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181478.480762:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1789181478.480786:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddd85ea0 reply state 0000000061389900 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.480797:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.480805:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:3.0:1789181478.480807:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181478.480811:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789181478.480848:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1789181478.480944:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+34:11920:x1876092385323904:12345-192.168.202.1@tcp:36:bash.0 Request processed in 533us (737us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789181478.480952:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 207 00000020:00080000:3.0:1789181478.480958:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789181478.487345:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181478.487467:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385324032 00000100:00100000:1.0:1789181478.487479:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385324032 00000100:00100000:1.0:1789181478.487539:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:1.0:1789181478.487549:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+34:11920:x1876092385324032:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181478.487576:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181478.487605:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517d7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.487673:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517d7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81b4 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.487688:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517d7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81b4 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.487706:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:1.0:1789181478.487709:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181478.487713:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12600, rc 0) 00000100:00100000:1.0:1789181478.487801:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:11920:x1876092385324032:12345-192.168.202.1@tcp:101:bash.0 Request processed in 253us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181478.487808:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 208 00000100:00100000:0.0:1789181478.492753:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181478.492860:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385324160 00000100:00100000:1.0:1789181478.492872:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385324160 00000100:00100000:1.0:1789181478.492956:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:1.0:1789181478.492967:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:11920:x1876092385324160:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181478.492988:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181478.493012:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ba7da7c/0x76fb555283517d86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81bb expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181478.493040:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4be24, atime: 0x6aa4be23, ctime: 0x6aa4be24, blocks: 0x8 00010000:00010000:1.0:1789181478.493065:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1789181478.493070:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181478.493078:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ba7da7c/0x76fb555283517d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81bb expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.493095:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ba7da7c/0x76fb555283517d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81bb expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.493119:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13400, rc 0) 00000100:00100000:1.0:1789181478.493181:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:11920:x1876092385324160:12345-192.168.202.1@tcp:101:bash.0 Request processed in 216us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181478.493188:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:3.0:1789181478.504474:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181478.505013:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385324288 00000100:00100000:1.0:1789181478.505024:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385324288 00002000:00010000:1.0:1789181478.505062:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1789181478.505066:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc3ba4e00 with x1876092385324288 ext(0->18446744073709551615) 00002000:00010000:1.0:1789181478.505078:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1cc3ba4e00. 00000100:00100000:1.0:1789181478.505103:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1789181478.505112:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385324288:12345-192.168.202.1@tcp:10:bash.0 00002000:00010000:1.0:1789181478.505650:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789181478.505655:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789181476 -> 1789181478 00002000:00010000:1.0:1789181478.505658:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789181475 -> 1789181475 00002000:00010000:1.0:1789181478.505661:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789181476 -> 1789181478 00002000:00010000:1.0:1789181478.505663:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789181478.505720:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385324288:12345-192.168.202.1@tcp:10:bash.0 Request processed in 609us (1254us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789181478.505763:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00002000:00010000:1.0:1789181478.505767:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1789181478.505770:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc3ba4e00 with x1876092385324288 ext(0->18446744073709551615) 00002000:00010000:1.0:1789181478.505774:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1cc3ba4e00. 00000100:00100000:2.0:1789181478.666945:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181478.667344:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385324416 00000100:00100000:3.0:1789181478.667359:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385324416 00000100:00100000:3.0:1789181478.667448:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:3.0:1789181478.667476:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:12402:x1876092385324416:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:3.0:1789181478.667601:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d8d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667624:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667649:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667669:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667677:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667684:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667853:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667865:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667872:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181478.667935:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667949:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667966:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d8d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667973:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667980:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181478.667986:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.667994:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668010:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:3.0:1789181478.668013:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181478.668018:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668024:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517d8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668040:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668045:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668051:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668056:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181478.668066:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668072:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668079:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dfadc6f00) 00010000:00010000:3.0:1789181478.668082:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181478.668085:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668090:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517d94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668107:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668113:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668119:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668124:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181478.668127:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668134:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668141:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:3.0:1789181478.668143:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181478.668153:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.668159:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517d9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181478.668698:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:12402:x1876092385324416:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 1233us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181478.668711:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 209 00000100:00100000:0.0:1789181478.760771:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181478.760838:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181478.760872:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181478.760965:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385324672 00000100:00100000:2.0:1789181478.760982:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385324672 00000100:00100000:1.0:1789181478.761015:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385324928 00000100:00100000:1.0:1789181478.761027:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385324928 00000100:00100000:1.0:1789181478.761088:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:2.0:1789181478.761095:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:1.0:1789181478.761104:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+35:12405:x1876092385324928:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181478.761129:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789181478.761137:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2395:x1876092385324672:12345-192.168.202.1@tcp:16:kworker.0 00010000:00010000:1.0:1789181478.761155:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517da2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.761234:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517da9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.761251:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517da9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.761264:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517da9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.761292:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517db0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.761301:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.761308:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.761418:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517db7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.761435:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517db7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181478.761442:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517db7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181478.761453:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789181478.762037:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517da9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762047:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517da9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762053:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517da9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762058:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181478.762062:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517da9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762070:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517da9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762082:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:0.0:1789181478.762085:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181478.762091:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517da9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762096:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517da9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762111:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762117:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517db0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762123:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517db0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762136:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181478.762139:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517db0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762146:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517db0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762155:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dc3dc5100) 00010000:00010000:0.0:1789181478.762157:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181478.762160:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517db0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762166:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283517db0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762210:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12a00/0x76fb555283517da2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81c2 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762225:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517db7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81c2 expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.762233:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:0.0:1789181478.762235:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789181478.762237:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13000, rc 0) 00000100:00100000:0.0:1789181478.762312:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:12405:x1876092385324928:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1213us (1473us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789181478.762322:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 210 00000100:00100000:3.0:1789181478.763096:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385324544 00000100:00100000:3.0:1789181478.763110:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385324544 00002000:00100000:3.0:1789181478.763153:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->7) req@ffff9c1dff905180 x1876092385324544/t0(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:609/0 lens 496/0 e 0 to 0 dl 1789181489 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181478.763164:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dff905180 with x1876092385324544 ext(0->7) 00002000:00010000:3.0:1789181478.763168:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1dff905180 00000100:00100000:3.0:1789181478.763199:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:3.0:1789181478.763208:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2395:x1876092385324544:12345-192.168.202.1@tcp:4:bash.0 00000100:00100000:3.0:1789181478.765771:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+12:2395:x1876092385324544:12345-192.168.202.1@tcp:4:bash.0 Request processed in 2549us (5040us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789181478.765787:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00002000:00100000:3.0:1789181478.765804:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->7) req@ffff9c1dff905180 x1876092385324544/t4294967320(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:609/0 lens 496/448 e 0 to 0 dl 1789181489 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181478.765814:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1dff905180 with x1876092385324544 ext(0->7) 00002000:00010000:3.0:1789181478.765821:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1dff905180 00000001:00080000:1.0:1789181478.767243:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1789181478.767261:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:2.0:1789181478.768634:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2395:x1876092385324672:12345-192.168.202.1@tcp:16:kworker.0 Request processed in 7484us (7740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181478.768650:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:2.0:1789181478.773301:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181478.774504:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385325056 00000100:00100000:3.0:1789181478.774518:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385325056 00000100:00100000:3.0:1789181478.774646:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:3.0:1789181478.774673:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:12405:x1876092385325056:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1789181478.774768:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.774787:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81a6 expref: 37 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.774796:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.774830:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81a6 expref: 37 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.774844:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81a6 expref: 37 pid: 9021 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181478.774859:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408451456:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181478.774970:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181478.781933:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181478.782062:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408451456:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181478.782092:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181478.785818:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385325312 00000100:00100000:2.0:1789181478.785839:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385325312 00000100:00100000:2.0:1789181478.785917:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1789181478.785928:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:6166:x1876092385325312:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789181478.786252:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+39:6166:x1876092385325312:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 325us (4327us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789181478.786260:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1789181478.802028:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181478.802133:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385325440 00000100:00100000:2.0:1789181478.802143:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385325440 00010000:00010000:2.0:1789181478.802187:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81a6 expref: 39 pid: 9021 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181478.802233:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 93 00000100:00100000:2.0:1789181478.802243:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+39:2394:x1876092385325440:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181478.802262:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181478.802269:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81a6 expref: 39 pid: 9021 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.802283:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81a6 expref: 39 pid: 9021 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.802325:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517d5c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81a6 expref: 39 pid: 9021 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.802342:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:2.0:1789181478.802347:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.802357:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.802365:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.802397:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181478.802457:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:2394:x1876092385325440:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 214us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181478.802466:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 93 00010000:00010000:3.0:1789181478.802781:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.802790:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.802831:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.802845:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.802851:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.802858:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181478.802862:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.802869:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.802877:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:3.0:1789181478.802880:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181478.802883:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181478.802888:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517dc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181478.802940:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:12405:x1876092385325056:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 28269us (29649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181478.802948:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 211 00000100:00100000:0.0:1789181478.805537:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181478.805634:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385325696 00000100:00100000:2.0:1789181478.805644:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385325696 00000100:00100000:2.0:1789181478.805700:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1789181478.805710:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+37:12405:x1876092385325696:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1789181478.805940:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:12405:x1876092385325696:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 230us (412us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789181478.805948:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:0.0:1789181478.922026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181478.922269:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385325952 00000100:00100000:2.0:1789181478.922280:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385325952 00000100:00100000:2.0:1789181478.922342:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:2.0:1789181478.922364:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+38:12416:x1876092385325952:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1789181478.922398:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181478.922418:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517dcc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81c9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922488:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dd3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922503:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922514:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922530:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517dda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922536:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517dda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922542:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517dda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922665:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517de1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922675:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922682:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181478.922701:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789181478.922803:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922811:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dd3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922818:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922823:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181478.922828:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922835:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922846:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:2.0:1789181478.922849:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181478.922853:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922859:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922870:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517dda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922877:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517dda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922891:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517dda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922896:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181478.922899:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517dda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922905:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517dda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922911:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dd10ab800) 00010000:00010000:2.0:1789181478.922913:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181478.922916:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517dda lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922921:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517dda lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922959:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517dcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81c9 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922972:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517de1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81c9 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.922979:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:2.0:1789181478.922981:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181478.922984:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a400, rc 0) 00000100:00100000:2.0:1789181478.923054:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+40:12416:x1876092385325952:12345-192.168.202.1@tcp:101:cat.0 Request processed in 691us (1040us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789181478.923070:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 212 00000100:00100000:0.0:1789181478.926984:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181478.927068:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385326208 00000100:00100000:2.0:1789181478.927081:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385326208 00000100:00100000:2.0:1789181478.927164:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1789181478.927174:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+40:12416:x1876092385326208:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:2.0:1789181478.927474:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+41:12416:x1876092385326208:12345-192.168.202.1@tcp:35:cat.0 Request processed in 300us (499us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789181478.927491:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1789181478.971593:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181478.972136:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385326464 00000100:00100000:2.0:1789181478.972158:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385326464 00000100:00100000:2.0:1789181478.972225:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 213 00000100:00100000:2.0:1789181478.972237:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+41:12417:x1876092385326464:12345-192.168.202.1@tcp:36:rm.0 00010000:00010000:2.0:1789181478.972293:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789181478.972323:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517d7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81b4 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972346:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517de1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81c9 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972360:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517db7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81c2 expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972373:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517d71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81ad expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972383:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:2.0:1789181478.972398:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181478.972422:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517def lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972437:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517def lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972449:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517def lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972463:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972471:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972477:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972552:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dfd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972561:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972568:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181478.972863:0:9021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789181478.972875:0:9021:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434960150576ns, next at 435960147334ns, rc = 0 00010000:00010000:2.0:1789181478.972923:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972941:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972949:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972957:0:9021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972963:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972969:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.972987:0:9021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181478.973005:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973011:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dfd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973018:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973036:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181478.973041:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973049:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dfd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973066:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:2.0:1789181478.973069:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789181478.973072:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dfd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973079:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517dfd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973093:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517def lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973099:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517def lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973105:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517def lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973110:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181478.973113:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517def lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973118:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517def lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973124:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:2.0:1789181478.973127:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181478.973129:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517def lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973134:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517def lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181478.973153:0:9021:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3bc2ba7 reply state 000000000e35bb5a transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973163:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181478.973169:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dd10ab800) 00010000:00010000:2.0:1789181478.973171:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789181478.973174:0:9021:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181478.973245:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+39:12417:x1876092385326464:12345-192.168.202.1@tcp:36:rm.0 Request processed in 1010us (1665us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789181478.973253:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 213 00010000:00010000:0.0:1789181478.973544:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181478.973552:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.973558:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084be00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181478.973562:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.973568:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.973577:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:0.0:1789181478.973579:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789181478.973582:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.973588:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084be00/0x76fb555283517e04 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181478.973597:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181478.973599:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181478.973601:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181479.026764:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.026867:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385326720 00000100:00100000:2.0:1789181479.026879:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385326720 00000100:00100000:2.0:1789181479.026964:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:2.0:1789181479.026976:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+39:12423:x1876092385326720:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1789181479.027006:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181479.027041:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517e0b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.027166:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.027183:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.027197:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.027230:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.027239:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.027246:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789181479.027592:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789181479.028117:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028305:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028318:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028364:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028371:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e12 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028378:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028385:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181479.028389:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028411:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028426:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:2.0:1789181479.028429:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181479.028435:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028442:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181479.028457:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a48e29e reply state 000000008e0f8fba transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028467:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028473:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dd10ab800) 00010000:00010000:2.0:1789181479.028476:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789181479.028478:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789181479.028507:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517e0b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d0 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028521:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d0 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.028528:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd10ab200) 00010000:00010000:2.0:1789181479.028530:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181479.028533:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084bc00, rc 0) 00000100:00080000:3.0:1789181479.029295:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181479.029456:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+42:12423:x1876092385326720:12345-192.168.202.1@tcp:101:bash.0 Request processed in 2478us (2727us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789181479.029476:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 214 00000100:00100000:0.0:1789181479.045474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181479.045720:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385326848 00000100:00100000:1.0:1789181479.045770:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385326848 00000100:00100000:1.0:1789181479.045847:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:1.0:1789181479.045859:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2395:x1876092385326848:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181479.045878:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181479.045899:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831ac6ac/0x76fb555283517e2e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81d7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181479.045945:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789181479.045967:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789181479.045972:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181479.045981:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831ac6ac/0x76fb555283517e2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d7 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.046000:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000831ac6ac/0x76fb555283517e2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d7 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.046016:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12400, rc 0) 00000100:00100000:1.0:1789181479.046307:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2395:x1876092385326848:12345-192.168.202.1@tcp:101:bash.0 Request processed in 450us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181479.046315:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00080000:3.0:1789181479.046391:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181479.051315:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181479.054776:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385326976 00000100:00100000:0.0:1789181479.054793:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385326976 00000100:00100000:0.0:1789181479.055085:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:0.0:1789181479.055105:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:12423:x1876092385326976:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1789181479.055147:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181479.055171:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81de expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.055208:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000831ac6ac/0x76fb555283517e2e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d7 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.055217:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181479.055221:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181479.055227:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.055266:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000831ac6ac/0x76fb555283517e2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d7 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.055280:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000831ac6ac/0x76fb555283517e2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d7 expref: 9 pid: 8437 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181479.055293:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1876092408451584:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181479.055409:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181479.064823:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1876092408451584:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181479.064864:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.064887:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0800, rc 0) 00000100:00100000:2.0:1789181479.065066:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:12423:x1876092385326976:12345-192.168.202.1@tcp:101:bash.0 Request processed in 9962us (13759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181479.065076:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:3.0:1789181479.065235:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.065353:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385327104 00000100:00100000:2.0:1789181479.065360:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385327104 00010000:00010000:2.0:1789181479.065391:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000831ac6ac/0x76fb555283517e2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d7 expref: 9 pid: 8437 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181479.065428:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:2.0:1789181479.065436:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385327104:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181479.065449:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181479.065470:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000831ac6ac/0x76fb555283517e2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d7 expref: 9 pid: 8437 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.065483:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000831ac6ac/0x76fb555283517e2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d7 expref: 9 pid: 8437 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.065504:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831ac6ac/0x76fb555283517e2e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d7 expref: 9 pid: 8437 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.065536:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181479.065540:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181479.065550:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.065560:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.065593:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181479.065619:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1876092408451712:192.168.202.1@tcp:105: 00000100:00100000:2.0:1789181479.065697:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7120e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181479.068019:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1876092408451712:192.168.202.1@tcp:105: 00010000:00010000:2.0:1789181479.068064:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181479.068164:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385327104:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 2727us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181479.068176:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 94 00000100:00100000:3.0:1789181479.069121:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.069174:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385327360 00000100:00100000:2.0:1789181479.069182:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385327360 00000100:00100000:2.0:1789181479.069236:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1789181479.069244:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+42:12423:x1876092385327360:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1789181479.069519:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:12423:x1876092385327360:12345-192.168.202.1@tcp:35:bash.0 Request processed in 275us (403us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789181479.069542:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1789181479.180213:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408451840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181479.180282:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181479.180412:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408451840 00000100:00100000:2.0:1789181479.180422:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408451840 00000100:00100000:2.0:1789181479.180484:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789181479.180492:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408451840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789181479.180520:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789181479.180566:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408451840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181479.180572:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789181479.180685:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408451840:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789181479.180759:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181479.181049:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181479.181060:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408451968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181479.181096:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181479.181169:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408451968 00000100:00100000:0.0:1789181479.181174:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408451968 00000100:00100000:0.0:1789181479.181238:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789181479.181245:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876092408451968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181479.181257:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181479.181293:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876092408451968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.181299:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1789181479.181361:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181479.181489:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408451968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181479.267239:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.267333:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385327488 00000100:00100000:2.0:1789181479.267343:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385327488 00000100:00100000:2.0:1789181479.267490:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:2.0:1789181479.267501:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+43:12439:x1876092385327488:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181479.267523:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181479.267547:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517e3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81e5 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.267612:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.267659:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.267674:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181479.267720:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789181479.267767:0:9021:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181479.267798:0:9021:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.267826:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517e3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81e5 expref: 45 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.267845:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81e5 expref: 44 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.267854:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:2.0:1789181479.267857:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181479.267860:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a800, rc 0) 00000100:00100000:2.0:1789181479.267922:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+44:12439:x1876092385327488:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 422us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181479.267929:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 215 00000100:00100000:2.0:1789181479.270312:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.270349:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.270434:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.270469:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181479.270638:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385327616 00000100:00100000:1.0:1789181479.270649:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385327616 00000100:00100000:1.0:1789181479.270705:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 392 00000100:00100000:1.0:1789181479.270715:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385327616:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181479.270806:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385327616:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 92us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181479.270827:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 392 00000100:00100000:3.0:1789181479.274964:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385327744 00000100:00100000:3.0:1789181479.274982:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385327744 00000100:00080000:3.0:1789181479.275026:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181479.275071:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385328000 00000100:00100000:3.0:1789181479.275075:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385328000 00000100:00080000:3.0:1789181479.275088:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181479.275101:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385327872 00000100:00100000:3.0:1789181479.275104:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385327872 00000100:00080000:3.0:1789181479.275116:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181479.275138:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 341 00000100:00100000:3.0:1789181479.275150:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385327744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181479.275271:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 342 00000100:00100000:0.0:1789181479.275281:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385328000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181479.275349:0:6522:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789181479.275358:0:6522:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789181479.275489:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 343 00000100:00100000:1.0:1789181479.275497:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385327872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181479.275902:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385327744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 754us (5597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181479.275910:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 341 00000100:00100000:0.0:1789181479.276004:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385328000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 725us (5653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.276011:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 342 00000100:00100000:1.0:1789181479.276205:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385327872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 708us (5740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181479.276212:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 343 00000100:00100000:2.0:1789181479.276304:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181479.276472:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385328256 00000100:00100000:0.0:1789181479.276478:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385328256 00000100:00100000:0.0:1789181479.276516:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:0.0:1789181479.276524:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+44:12439:x1876092385328256:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181479.276537:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181479.276556:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517e4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81ec expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.276671:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517e51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.276686:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517e51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.276698:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517e51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181479.276720:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789181479.276865:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517e4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81ec expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.276881:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517e51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81ec expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.276889:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd10ab200) 00010000:00010000:0.0:1789181479.276892:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181479.276896:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1000, rc 0) 00000100:00100000:0.0:1789181479.276928:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+46:12439:x1876092385328256:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 404us (624us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789181479.276935:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 216 00000100:00100000:2.0:1789181479.280961:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.281007:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181479.281109:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385328512 00000100:00100000:3.0:1789181479.281120:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385328512 00000100:00100000:3.0:1789181479.281189:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00100000:3.0:1789181479.281200:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+46:12439:x1876092385328512:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181479.281229:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181479.281253:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517e5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81f3 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.281361:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517e66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.281377:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517e66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.281403:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517e66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181479.281436:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789181479.281554:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517e5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81f3 expref: 49 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.281571:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517e66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81f3 expref: 48 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.281580:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd10ab200) 00010000:00010000:3.0:1789181479.281583:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789181479.281587:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f600, rc 0) 00000100:00100000:3.0:1789181479.281654:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+48:12439:x1876092385328512:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 455us (704us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789181479.281661:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 217 00000100:00100000:3.0:1789181479.285672:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.285925:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385328768 00000100:00100000:2.0:1789181479.285936:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385328768 00000100:00100000:2.0:1789181479.285999:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1789181479.286010:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385328768:12345-192.168.202.1@tcp:1:lfs.0 00010000:00010000:2.0:1789181479.286056:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.286094:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.286102:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181479.286107:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181479.286111:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.286144:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.286159:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 8 pid: 8435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181479.286172:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1876092408452096:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181479.286256:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7120180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181479.288589:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385328640 00000100:00100000:1.0:1789181479.288603:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385328640 00000100:00100000:1.0:1789181479.288686:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1789181479.288696:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc70a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+48:2396:x1876092385328640:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181479.288713:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181479.288765:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517e51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81ec expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.288785:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd10ab200) 00010000:00010000:1.0:1789181479.288790:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181479.288850:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc70a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+47:2396:x1876092385328640:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 154us (7841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181479.288857:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:0.0:1789181479.290484:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181479.290552:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385328896 00000100:00100000:3.0:1789181479.290561:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385328896 00002000:00100000:3.0:1789181479.290602:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c1cc46bf480 x1876092385328896/t0(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:610/0 lens 504/0 e 0 to 0 dl 1789181490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181479.290614:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc46bf480 with x1876092385328896 ext(0->8) 00010000:00010000:3.0:1789181479.290636:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 9 pid: 8435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.290654:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 9 pid: 8435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789181479.290662:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c1cc46bf480 00000100:00100000:3.0:1789181479.290707:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1789181479.290717:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385328896:12345-192.168.202.1@tcp:4:lfs.0 00000100:00100000:2.0:1789181479.291522:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1876092408452096:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181479.291549:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181479.292980:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:2393:x1876092385328896:12345-192.168.202.1@tcp:4:lfs.0 Request processed in 2255us (2494us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789181479.292994:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00002000:00100000:3.0:1789181479.293007:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c1cc46bf480 x1876092385328896/t4294967309(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:610/0 lens 504/448 e 0 to 0 dl 1789181490 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181479.293017:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc46bf480 with x1876092385328896 ext(0->8) 00010000:00010000:3.0:1789181479.293027:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 11 pid: 8435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.293044:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 11 pid: 8435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789181479.293052:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c1cc46bf480 00000100:00100000:2.0:1789181479.302010:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181479.302140:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385329024 00000100:00100000:0.0:1789181479.302151:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385329024 00010000:00010000:0.0:1789181479.302197:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 11 pid: 8435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181479.302414:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 95 00000100:00100000:0.0:1789181479.302427:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:2394:x1876092385329024:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181479.302449:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789181479.302468:0:7462:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789181479.302472:0:7462:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789181478 00002000:00010000:0.0:1789181479.302474:0:7462:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789181479 00002000:00010000:0.0:1789181479.302477:0:7462:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789181478 00002000:00010000:0.0:1789181479.302493:0:7462:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789181479.302500:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 11 pid: 8435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.302514:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 11 pid: 8435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.302538:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cac33fdf/0x76fb555283517e35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81de expref: 11 pid: 8435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.302555:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181479.302559:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181479.302564:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.302574:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.302636:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181479.302702:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2394:x1876092385329024:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 277us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.302710:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 95 00010000:00010000:3.0:1789181479.302805:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.302817:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.302838:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.302846:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.302861:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.302869:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181479.302873:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.302882:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.302895:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.302902:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283517e74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181479.302953:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385328768:12345-192.168.202.1@tcp:1:lfs.0 Request processed in 16945us (17291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181479.302961:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:2.0:1789181479.311685:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181479.311754:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385329280 00000100:00100000:1.0:1789181479.311764:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385329280 00000100:00100000:1.0:1789181479.311817:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1789181479.311827:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd13d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+47:12439:x1876092385329280:12345-192.168.202.1@tcp:35:lfs.0 00000004:00010000:1.0:1789181479.311911:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517e66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81f3 expref: 47 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789181479.312090:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789181479.312134:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789181479.312430:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1789181479.312470:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.312485:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d0 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.312494:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.312530:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d0 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.312545:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d0 expref: 51 pid: 6521 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181479.312560:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45cf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876092408452224:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181479.312656:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181479.314550:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.314586:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45cf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1876092408452224:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181479.314614:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181479.314637:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385329408 00000100:00100000:3.0:1789181479.314646:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385329408 00010000:00010000:3.0:1789181479.314681:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d0 expref: 52 pid: 6521 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181479.314754:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 96 00000100:00100000:3.0:1789181479.314772:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+52:2394:x1876092385329408:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181479.314787:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181479.314794:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d0 expref: 52 pid: 6521 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.314806:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d0 expref: 52 pid: 6521 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.314830:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517e20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81d0 expref: 52 pid: 6521 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.314845:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd10ab200) 00010000:00010000:3.0:1789181479.314849:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.314859:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.314867:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.314888:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181479.314911:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.314919:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181479.314935:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+51:2394:x1876092385329408:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 165us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181479.314942:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 96 00000001:00080000:2.0:1789181479.315025:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1789181479.315140:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1789181479.315223:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408452352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789181479.315267:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181479.315332:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408452352 00000100:00100000:0.0:1789181479.315338:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408452352 00000100:00100000:0.0:1789181479.315374:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789181479.315393:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6524:x1876092408452352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789181479.315464:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6524:x1876092408452352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.315479:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789181479.315512:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7120cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181479.315530:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408452352:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789181479.315845:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789181479.315887:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408452480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789181479.315915:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181479.315940:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc71200c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181479.315952:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408452480 00000100:00100000:3.0:1789181479.315958:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408452480 00000100:00100000:3.0:1789181479.315986:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789181479.315991:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1876092408452480:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789181479.316075:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6524:x1876092408452480:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (159us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789181479.316082:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789181479.316104:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1876092408452480:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789181479.316203:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789181479.316233:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.316242:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.316248:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.316254:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181479.316264:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.316271:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.316448:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd10ab200) 00010000:00010000:2.0:1789181479.316452:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789181479.316457:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.316465:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb555283517e7b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789181479.316566:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789181479.316650:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789181479.316663:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 435303938880ns, next at 436303935560ns, rc = 0 00000001:00080000:2.0:1789181479.316670:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1789181479.316941:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd10ab200) 00010000:00010000:2.0:1789181479.316945:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789181479.316951:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f600/0x76fb555283517e66 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81f3 expref: 55 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181479.317052:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd13d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:12439:x1876092385329280:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 5225us (5376us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789181479.317059:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000020:00080000:2.0:1789181479.317064:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789181479.319509:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181479.319593:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385329536 00000100:00100000:0.0:1789181479.319603:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385329536 00000100:00100000:0.0:1789181479.319676:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:0.0:1789181479.319686:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+54:12439:x1876092385329536:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181479.319709:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181479.319761:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517e82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df81fa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.319823:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517e82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81fa expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.319837:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517e82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81fa expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.319873:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:0.0:1789181479.319876:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789181479.319880:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0800, rc 0) 00000100:00100000:0.0:1789181479.319942:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+55:12439:x1876092385329536:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 257us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.319949:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 218 00000100:00100000:3.0:1789181479.321588:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181479.321792:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385329792 00000100:00100000:1.0:1789181479.321801:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385329792 00000100:00100000:1.0:1789181479.321855:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:1.0:1789181479.321864:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+55:12439:x1876092385329792:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1789181479.322102:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+56:12439:x1876092385329792:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 237us (518us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789181479.322110:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:2.0:1789181479.413825:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181479.413912:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385329920 00000100:00100000:0.0:1789181479.413922:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385329920 00000100:00100000:0.0:1789181479.413984:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:0.0:1789181479.413995:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+56:12449:x1876092385329920:12345-192.168.202.1@tcp:34:lfs.0 00010000:00010000:0.0:1789181479.414090:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517e89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414135:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517e89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414149:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517e89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414161:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517e90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414168:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414175:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414259:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414267:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414274:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181479.414341:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414355:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517e89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414362:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517e89 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414570:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517e89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414578:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181479.414583:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517e89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414591:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517e89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414604:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:0.0:1789181479.414607:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181479.414613:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517e89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414629:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517e89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414647:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414652:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517e90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414657:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414662:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181479.414665:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414681:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517e90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414689:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dd10ab800) 00010000:00010000:0.0:1789181479.414691:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181479.414694:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517e90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414700:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb555283517e90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414708:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414714:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414718:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414780:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0a00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181479.414783:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414789:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414797:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:0.0:1789181479.414800:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181479.414803:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.414819:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0a00/0x76fb555283517e97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181479.414894:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+56:12449:x1876092385329920:12345-192.168.202.1@tcp:34:lfs.0 Request processed in 899us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.414902:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 219 00000100:00100000:0.0:1789181479.460898:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.461011:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385330176 00000100:00100000:2.0:1789181479.461022:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385330176 00000100:00100000:2.0:1789181479.461106:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:2.0:1789181479.461132:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+56:12452:x1876092385330176:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181479.461156:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181479.461182:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517e9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8201 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461261:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ea5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461277:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461496:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461510:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517eac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461518:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461524:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461646:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461655:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461662:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181479.461684:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789181479.461804:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461813:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ea5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461821:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461828:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084bc00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181479.461833:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461841:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ea5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461854:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:2.0:1789181479.461857:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181479.461862:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ea5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461869:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517ea5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461884:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461891:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517eac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461908:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517eac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461913:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084ac00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181479.461917:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517eac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461924:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517eac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461932:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dd10ab800) 00010000:00010000:2.0:1789181479.461935:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181479.461938:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517eac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461944:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283517eac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461982:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517e9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8201 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.461996:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8201 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.462001:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181479.462003:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181479.462005:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b600, rc 0) 00000100:00100000:2.0:1789181479.462050:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:12452:x1876092385330176:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 922us (1164us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789181479.462062:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 220 00000100:00100000:3.0:1789181479.464765:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181479.464924:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385330304 00000100:00100000:1.0:1789181479.464936:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385330304 00000100:00100000:1.0:1789181479.464996:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:1.0:1789181479.465008:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:12452:x1876092385330304:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1789181479.465078:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517ec1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.465094:0:14725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.465254:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.465305:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.465312:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.465320:0:14725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.465326:0:14725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181479.465330:0:14725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.465338:0:14725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.465365:0:14725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:1.0:1789181479.465368:0:14725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181479.465373:0:14725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517ec1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.465379:0:14725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517ec1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181479.465456:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:12452:x1876092385330304:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 450us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181479.465462:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 221 00000100:00100000:1.0:1789181479.467917:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.468063:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385330560 00000100:00100000:2.0:1789181479.468073:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385330560 00000100:00100000:2.0:1789181479.468218:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:2.0:1789181479.468229:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+58:12452:x1876092385330560:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1789181479.468480:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:12452:x1876092385330560:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 252us (781us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1789181479.468487:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00010000:00010000:2.0:1789181479.500059:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181479.536037:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181479.536126:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385330816 00000100:00100000:3.0:1789181479.536145:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385330816 00000100:00100000:3.0:1789181479.536203:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:3.0:1789181479.536213:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:12462:x1876092385330816:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1789181479.536238:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181479.536249:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789181479.536278:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283517e43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81e5 expref: 59 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.536301:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:3.0:1789181479.536418:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181479.536433:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517ec8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8208 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.536531:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.536546:0:9021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8201 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.536555:0:9021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.536606:0:9021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8201 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.536630:0:9021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8201 expref: 59 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181479.536643:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408452608:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181479.536918:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31180 going to sleep for 11 seconds 00000100:00100000:0.0:1789181479.562321:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181479.562592:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408452608:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181479.562635:0:9021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181479.562780:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385330944 00000100:00100000:2.0:1789181479.562789:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385330944 00010000:00010000:2.0:1789181479.562833:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8201 expref: 60 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181479.562884:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 97 00000100:00100000:2.0:1789181479.562894:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:2394:x1876092385330944:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181479.562913:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181479.562920:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8201 expref: 60 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.562932:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8201 expref: 60 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.562987:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283517eb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8201 expref: 60 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.563023:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181479.563028:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.563037:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.563046:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.563074:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181479.563127:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:2394:x1876092385330944:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 234us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181479.563143:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 97 00010000:00010000:3.0:1789181479.563440:0:9021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.563449:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181479.563468:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789181479.563590:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517ec8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8208 expref: 60 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.563606:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8208 expref: 59 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.563614:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:3.0:1789181479.563627:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789181479.563638:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e000, rc 0) 00000100:00100000:3.0:1789181479.563667:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:12462:x1876092385330816:12345-192.168.202.1@tcp:101:bash.0 Request processed in 27456us (27639us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789181479.563675:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 222 00000100:00100000:1.0:1789181479.567574:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181479.567688:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385331072 00000100:00100000:0.0:1789181479.567699:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385331072 00000100:00100000:0.0:1789181479.567803:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:0.0:1789181479.567817:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd135fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+59:12462:x1876092385331072:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1789181479.568007:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181479.568035:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517edd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df820f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.568075:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.568091:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.568102:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.569354:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517edd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df820f expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.569401:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df820f expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.569410:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:0.0:1789181479.569414:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789181479.569417:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0c00, rc 0) 00000100:00100000:0.0:1789181479.569512:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd135fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:12462:x1876092385331072:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1697us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.569521:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 223 00000100:00100000:0.0:1789181479.579669:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181479.580085:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385331328 00000100:00100000:1.0:1789181479.580096:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385331328 00000100:00100000:1.0:1789181479.580177:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 224 00000100:00100000:1.0:1789181479.580198:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+60:12462:x1876092385331328:12345-192.168.202.1@tcp:36:bash.0 00010000:00010000:1.0:1789181479.580450:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.580468:0:14725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.580479:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789181479.580519:0:14725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1789181479.580539:0:14725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d6c5511 reply state 000000007548a13d transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.580568:0:14725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.580575:0:14725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:1.0:1789181479.580577:0:14725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789181479.580581:0:14725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789181479.580691:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:12462:x1876092385331328:12345-192.168.202.1@tcp:36:bash.0 Request processed in 494us (1035us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789181479.580698:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 224 00000020:00080000:1.0:1789181479.580702:0:14725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789181479.586279:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181479.586466:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385331456 00000100:00100000:3.0:1789181479.586477:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385331456 00000100:00100000:3.0:1789181479.586547:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:3.0:1789181479.586558:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:12462:x1876092385331456:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1789181479.586583:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181479.586604:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517ef2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8216 expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.586710:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.586761:0:9021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8208 expref: 64 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.586771:0:9021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.586810:0:9021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8208 expref: 64 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.586823:0:9021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8208 expref: 64 pid: 9021 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181479.586838:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408452736:192.168.202.1@tcp:104: 00000100:00100000:3.0:1789181479.586916:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181479.591785:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181479.591868:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385331584 00000100:00100000:0.0:1789181479.591878:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385331584 00010000:00010000:0.0:1789181479.591920:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8208 expref: 65 pid: 9021 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181479.591963:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:0.0:1789181479.591973:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:2393:x1876092385331584:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181479.591989:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181479.591996:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8208 expref: 65 pid: 9021 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.592009:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8208 expref: 65 pid: 9021 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.592032:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:0.0:1789181479.592053:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.592063:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.592070:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.592090:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181479.592319:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283517ecf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8208 expref: 65 pid: 9021 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181479.592337:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408452736:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181479.592358:0:9021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.592366:0:9021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.592372:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181479.592448:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789181479.592452:0:9021:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181479.592484:0:9021:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.592518:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517ef2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8216 expref: 65 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.592532:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8216 expref: 64 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.592540:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:3.0:1789181479.592543:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181479.592546:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e200, rc 0) 00000100:00100000:0.0:1789181479.592593:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:2393:x1876092385331584:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 620us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.592602:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 98 00000100:00100000:3.0:1789181479.593119:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:12462:x1876092385331456:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6560us (6847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181479.593126:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 225 00000100:00100000:0.0:1789181479.605371:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181479.606863:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385331840 00000100:00100000:1.0:1789181479.606875:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385331840 00000100:00100000:1.0:1789181479.606938:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:1.0:1789181479.606948:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+63:12462:x1876092385331840:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:1.0:1789181479.607906:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:12462:x1876092385331840:12345-192.168.202.1@tcp:35:bash.0 Request processed in 952us (2538us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789181479.607917:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1789181479.711446:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181479.711595:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385331968 00000100:00100000:0.0:1789181479.711605:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385331968 00000100:00100000:0.0:1789181479.711685:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:0.0:1789181479.711699:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+64:12468:x1876092385331968:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181479.711770:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181479.711791:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517f00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df821d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.711869:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517f07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.711884:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517f07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.711899:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517f07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181479.711971:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789181479.711975:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181479.711996:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517f07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.712023:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517f00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df821d expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.712044:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517f07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df821d expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.712054:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:0.0:1789181479.712058:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181479.712063:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1e00, rc 0) 00000100:00100000:0.0:1789181479.712124:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12468:x1876092385331968:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 429us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.712132:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 226 00000100:00100000:3.0:1789181479.724807:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181479.724947:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385332096 00000100:00100000:2.0:1789181479.724958:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385332096 00000100:00100000:2.0:1789181479.725057:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 227 00000100:00100000:2.0:1789181479.725070:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12468:x1876092385332096:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181479.725089:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181479.725109:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517f0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8224 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725175:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725190:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725221:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725233:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725240:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725246:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725318:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725328:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725335:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181479.725389:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789181479.725394:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181479.725414:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725427:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725435:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725452:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725459:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725763:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181479.725767:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725776:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725789:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:2.0:1789181479.725792:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181479.725797:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725802:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725815:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725821:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725827:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725831:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181479.725842:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725847:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725855:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dd10ab800) 00010000:00010000:2.0:1789181479.725857:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181479.725859:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725864:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725888:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283517f0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8224 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725900:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8224 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.725907:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181479.725909:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181479.725911:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a200, rc 0) 00000100:00100000:2.0:1789181479.725982:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12468:x1876092385332096:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 915us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181479.725990:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 227 00000100:00100000:3.0:1789181479.730399:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181479.730487:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181479.731024:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385332352 00000100:00100000:0.0:1789181479.731035:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385332352 00000100:00100000:0.0:1789181479.731101:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 228 00000100:00100000:0.0:1789181479.731112:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12468:x1876092385332352:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1789181479.731134:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181479.731156:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517f2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df822b expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.731259:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.731289:0:9021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8216 expref: 67 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.731298:0:9021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8224 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.731306:0:9021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.731338:0:9021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8224 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.731352:0:9021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8224 expref: 67 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181479.731365:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408452864:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181479.731604:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385332480 00000100:00100000:1.0:1789181479.731610:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385332480 00010000:00010000:1.0:1789181479.731643:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8224 expref: 68 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181479.731681:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 99 00000100:00100000:1.0:1789181479.731688:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:2394:x1876092385332480:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181479.731708:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181479.731714:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8224 expref: 68 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.731763:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8224 expref: 68 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.731781:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:1.0:1789181479.731785:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.731792:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.731798:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181479.731855:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:2394:x1876092385332480:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 168us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181479.731862:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 99 00010000:00010000:0.0:1789181479.732842:0:9021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8216 expref: 67 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.732859:0:9021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8216 expref: 67 pid: 9021 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181479.732871:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408452992:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181479.732898:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d53c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789181479.737447:0:9021:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.1@tcp) returned -22 from blocking AST (req@000000001479195c x1876092408452864) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8224 expref: 67 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.737511:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb555283517f23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8224 expref: 67 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181479.737530:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408452864:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181479.740877:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408452992:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181479.740911:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:0.0:1789181479.740918:0:9021:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.740930:0:9021:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.740939:0:9021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181479.741194:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181479.741261:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385332608 00000100:00100000:0.0:1789181479.741268:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385332608 00010000:00010000:0.0:1789181479.741300:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8216 expref: 67 pid: 9021 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181479.741338:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 100 00000100:00100000:0.0:1789181479.741347:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:2395:x1876092385332608:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181479.741360:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181479.741366:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8216 expref: 67 pid: 9021 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.741409:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8216 expref: 67 pid: 9021 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.741433:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb555283517ef9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8216 expref: 67 pid: 9021 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.741448:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:0.0:1789181479.741452:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.741460:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.741468:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181479.741504:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181479.741563:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:2395:x1876092385332608:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 216us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.741572:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 100 00010000:00010000:2.0:1789181479.741693:0:9021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.741702:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181479.741763:0:9021:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789181479.741909:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1600/0x76fb555283517f2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df822b expref: 67 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.741926:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df822b expref: 66 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181479.741933:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181479.741935:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181479.741938:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0000, rc 0) 00000100:00100000:2.0:1789181479.741963:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12468:x1876092385332352:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 10854us (11584us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789181479.741970:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 228 00000100:00100000:3.0:1789181479.746528:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181479.746697:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385332864 00000100:00100000:1.0:1789181479.746707:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385332864 00000100:00100000:1.0:1789181479.746812:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1789181479.746825:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd63d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12468:x1876092385332864:12345-192.168.202.1@tcp:103:lfs.0 00010000:00010000:1.0:1789181479.746840:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181479.746865:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283517e82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81fa expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.746883:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:1.0:1789181479.746899:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181479.746957:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd63d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12468:x1876092385332864:12345-192.168.202.1@tcp:103:lfs.0 Request processed in 134us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181479.746964:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:3.0:1789181479.749912:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181479.750015:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385332992 00000100:00100000:1.0:1789181479.750027:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385332992 00000100:00100000:1.0:1789181479.750078:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:1.0:1789181479.750088:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12468:x1876092385332992:12345-192.168.202.1@tcp:58:lfs.0 00010000:00010000:1.0:1789181479.750203:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.750221:0:14725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181479.750234:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181479.750335:0:14725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789181479.750717:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12468:x1876092385332992:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 628us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181479.750747:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 229 00000100:00100000:2.0:1789181479.754682:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181479.754868:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385333120 00000100:00100000:3.0:1789181479.754878:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385333120 00000100:00100000:3.0:1789181479.754932:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:3.0:1789181479.754941:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+65:12468:x1876092385333120:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181479.754964:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181479.754984:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517f46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8232 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.755035:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.755048:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517f46 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8232 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.755066:0:6523:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.755078:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517f46 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8232 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.755092:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:3.0:1789181479.755095:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181479.755099:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517f46 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8232 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181479.755125:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f400, rc 0) 00000100:00100000:3.0:1789181479.755191:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12468:x1876092385333120:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 251us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181479.755198:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 230 00000100:00100000:2.0:1789181480.205859:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408453120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181480.205933:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181480.206107:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408453120 00000100:00100000:0.0:1789181480.206115:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408453120 00000100:00100000:0.0:1789181480.206154:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789181480.206160:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408453120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181480.206188:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789181480.206232:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408453120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.206244:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789181480.206941:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408453120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789181480.523943:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181480.587946:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181480.587955:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181480.587973:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789181480.587982:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789181480.588109:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408453248:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789181480.588229:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181480.596517:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.596630:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385333248 00000100:00100000:0.0:1789181480.596640:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385333248 00000100:00100000:0.0:1789181480.596714:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:0.0:1789181480.596760:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:12469:x1876092385333248:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789181480.596797:0:9021:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789181480.596928:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:12469:x1876092385333248:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 203us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.596936:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 231 00000100:00100000:3.0:1789181480.597466:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408453248:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789181480.606781:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.606928:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385333376 00000100:00100000:1.0:1789181480.606941:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385333376 00000100:00100000:1.0:1789181480.607013:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:1.0:1789181480.607026:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12469:x1876092385333376:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789181480.607107:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517f4d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607128:0:14725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517f4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607158:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517f4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607176:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f54 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607185:0:14725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607191:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607214:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607223:0:14725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607229:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181480.607286:0:14725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789181480.607292:0:14725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181480.607310:0:14725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607322:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517f4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607328:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517f4d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607345:0:14725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517f4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607352:0:14725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181480.607357:0:14725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517f4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607365:0:14725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517f4d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607387:0:14725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:1.0:1789181480.607391:0:14725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181480.607397:0:14725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517f4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607404:0:14725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12200/0x76fb555283517f4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607422:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607428:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f54 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607433:0:14725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607438:0:14725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181480.607441:0:14725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607456:0:14725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f54 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607866:0:14725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9c1dc3dc5600) 00010000:00010000:1.0:1789181480.607868:0:14725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181480.607872:0:14725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f54 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607878:0:14725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f54 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607897:0:14725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607903:0:14725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607909:0:14725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607914:0:14725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181480.607917:0:14725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607924:0:14725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607931:0:14725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:1.0:1789181480.607933:0:14725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181480.607936:0:14725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.607952:0:14725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181480.608035:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12469:x1876092385333376:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 1011us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181480.608043:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 232 00000100:00100000:1.0:1789181480.610921:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181480.611021:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385333632 00000100:00100000:2.0:1789181480.611031:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385333632 00000100:00100000:2.0:1789181480.611094:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:2.0:1789181480.611107:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+66:12469:x1876092385333632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181480.611129:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181480.611153:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8239 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611279:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611295:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611306:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181480.611318:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789181480.611418:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611425:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611432:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611439:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181480.611444:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611452:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611606:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181480.611638:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789181480.611644:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611663:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a000/0x76fb555283517f69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611709:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f62 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8239 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611720:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:2.0:1789181480.611775:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181480.611780:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517f62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8239 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.611790:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b000, rc 0) 00000100:00100000:2.0:1789181480.611861:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:12469:x1876092385333632:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 757us (956us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789181480.611869:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 233 00000100:00100000:2.0:1789181480.615271:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.615361:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385333760 00000100:00100000:0.0:1789181480.615372:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385333760 00000100:00100000:0.0:1789181480.615443:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:0.0:1789181480.615454:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:12469:x1876092385333760:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789181480.615498:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789181480.615624:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:12469:x1876092385333760:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 170us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.615631:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 234 00000100:00100000:3.0:1789181480.626681:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.626995:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385334016 00000100:00100000:1.0:1789181480.627008:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385334016 00000100:00100000:1.0:1789181480.627068:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:1.0:1789181480.627079:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:12469:x1876092385334016:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181480.627101:0:14725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181480.627104:0:14725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789181480.627129:0:14725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1e00/0x76fb555283517f07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df821d expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.627149:0:14725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:1.0:1789181480.627154:0:14725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181480.627168:0:14725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8240 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789181480.627590:0:14725:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789181480.627804:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.627819:0:14725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.627850:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.627907:0:14725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb555283517f77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8240 expref: 69 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.627923:0:14725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8240 expref: 68 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.627931:0:14725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dc3dc5600) 00010000:00010000:1.0:1789181480.627934:0:14725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181480.627937:0:14725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13000, rc 0) 00000100:00100000:1.0:1789181480.628004:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:12469:x1876092385334016:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 927us (1335us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789181480.628012:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 235 00000100:00100000:1.0:1789181480.632695:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.633900:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385334272 00000100:00100000:0.0:1789181480.633921:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385334272 00000100:00100000:0.0:1789181480.634001:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:0.0:1789181480.634013:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:12469:x1876092385334272:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789181480.634086:0:9021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181480.634118:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517f7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8240 expref: 68 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634161:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dc3dc5600) 00010000:00010000:0.0:1789181480.634173:0:9021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181480.634195:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517f8c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634208:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517f8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634219:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517f8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634231:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517f93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x7a8c037f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634238:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a8c037f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634244:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a8c037f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634287:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517f8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634295:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517f8c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634301:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517f8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634307:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181480.634311:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517f8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634325:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517f8c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634333:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:0.0:1789181480.634336:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181480.634340:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517f8c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634345:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517f8c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634354:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a8c037f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634360:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517f93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a8c037f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634549:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517f93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a8c037f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634558:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:0.0:1789181480.634561:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517f93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a8c037f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634566:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517f93 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a8c037f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634574:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x7a8c037f (ffff9c1dd82e2c00) 00010000:00010000:0.0:1789181480.634576:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181480.634579:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517f93 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7a8c037f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.634594:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517f93 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7a8c037f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.634699:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:12469:x1876092385334272:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 687us (2016us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789181480.634707:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 236 00000100:00100000:3.0:1789181480.637204:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.637288:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385334400 00000100:00100000:0.0:1789181480.637298:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385334400 00000100:00100000:0.0:1789181480.637356:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:0.0:1789181480.637371:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+67:12469:x1876092385334400:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181480.637397:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181480.637420:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517f9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8247 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.637458:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.637598:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.637619:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.637774:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517f9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8247 expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.637791:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8247 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.637811:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:0.0:1789181480.637813:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789181480.637816:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1800, rc 0) 00000100:00100000:0.0:1789181480.637858:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:12469:x1876092385334400:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 495us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.637863:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 237 00000100:00100000:3.0:1789181480.640217:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181480.640380:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385334656 00000100:00100000:2.0:1789181480.640389:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385334656 00000100:00100000:2.0:1789181480.640439:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 238 00000100:00100000:2.0:1789181480.640448:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+68:12469:x1876092385334656:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789181480.640531:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.640545:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.640554:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181480.640774:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1789181480.640782:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 436628058123ns, next at 437628056116ns, rc = 0 00000004:00010000:2.0:1789181480.640821:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fed570d4 reply state 00000000007b5f58 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.640830:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.640835:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:2.0:1789181480.640837:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789181480.640840:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181480.640912:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+70:12469:x1876092385334656:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 466us (707us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789181480.640917:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 238 00000100:00100000:1.0:1789181480.643031:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.643215:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385334784 00000100:00100000:0.0:1789181480.643223:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385334784 00000100:00100000:0.0:1789181480.643262:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 239 00000100:00100000:0.0:1789181480.643269:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+70:12469:x1876092385334784:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181480.643291:0:9021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181480.643306:0:9021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517faf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df824e expref: -99 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.643361:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517faf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df824e expref: 71 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.643382:0:9021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517faf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df824e expref: 71 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.643402:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:0.0:1789181480.643404:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789181480.643407:0:9021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1000, rc 0) 00000100:00100000:0.0:1789181480.643464:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+71:12469:x1876092385334784:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 196us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.643486:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 239 00000100:00100000:3.0:1789181480.645355:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181480.645468:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385334912 00000100:00100000:2.0:1789181480.645478:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385334912 00000100:00100000:2.0:1789181480.645547:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00100000:2.0:1789181480.645558:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385334912:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789181480.645967:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385334912:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 411us (617us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789181480.645973:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 71 00000100:00080000:3.0:1789181480.646342:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181480.648713:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181480.648928:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385335168 00000100:00100000:2.0:1789181480.648937:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385335168 00000100:00100000:2.0:1789181480.648986:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:2.0:1789181480.648994:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+71:12469:x1876092385335168:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789181480.649217:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+72:12469:x1876092385335168:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 223us (516us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789181480.649234:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:1.0:1789181480.651332:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.651420:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385335424 00000100:00100000:0.0:1789181480.651429:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385335424 00000100:00100000:0.0:1789181480.651493:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:0.0:1789181480.651503:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+72:12469:x1876092385335424:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789181480.651622:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+72:12469:x1876092385335424:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 121us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.651628:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 240 00000100:00100000:3.0:1789181480.656031:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.656140:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385335552 00000100:00100000:0.0:1789181480.656153:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385335552 00000100:00100000:0.0:1789181480.656217:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 241 00000100:00100000:0.0:1789181480.656228:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+72:12469:x1876092385335552:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181480.656250:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181480.656272:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517fb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8255 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.656339:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517fbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.656355:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517fbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.656378:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517fbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181480.656426:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181480.656447:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517fbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.656487:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0200/0x76fb555283517fb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8255 expref: 74 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.656505:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517fbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8255 expref: 73 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.656515:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:0.0:1789181480.656518:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789181480.656521:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1400, rc 0) 00000100:00100000:0.0:1789181480.656583:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+73:12469:x1876092385335552:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 356us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.656590:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 241 00000100:00100000:3.0:1789181480.659929:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.660092:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385335680 00000100:00100000:1.0:1789181480.660102:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385335680 00000100:00100000:1.0:1789181480.660162:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1789181480.660175:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385335680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181480.660193:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181480.660216:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da7fd9b4/0x76fb555283517fc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df825c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181480.660259:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4be28, blocks: 0x0 00010000:00010000:1.0:1789181480.660281:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1789181480.660286:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181480.660296:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da7fd9b4/0x76fb555283517fc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df825c expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.660313:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da7fd9b4/0x76fb555283517fc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df825c expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.660326:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13a00, rc 0) 00000100:00100000:1.0:1789181480.660396:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385335680:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 224us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181480.660403:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:1.0:1789181480.663306:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.663453:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385335936 00000100:00100000:0.0:1789181480.663464:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385335936 00000100:00100000:0.0:1789181480.663530:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:0.0:1789181480.663541:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+73:12469:x1876092385335936:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789181480.663672:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+73:12469:x1876092385335936:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 132us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.663679:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 242 00000100:00100000:2.0:1789181480.667021:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.667114:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385336064 00000100:00100000:0.0:1789181480.667125:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385336064 00000100:00100000:0.0:1789181480.667181:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:0.0:1789181480.667192:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:12469:x1876092385336064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181480.667210:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181480.667228:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8263 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.667275:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da7fd9b4/0x76fb555283517fc4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df825c expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.667284:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181480.667288:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181480.667294:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.667329:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da7fd9b4/0x76fb555283517fc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df825c expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.667342:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da7fd9b4/0x76fb555283517fc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df825c expref: 10 pid: 8437 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.667357:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1876092408453376:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181480.667474:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181480.669933:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1876092408453376:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181480.669978:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.670002:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0200, rc 0) 00000100:00100000:0.0:1789181480.670060:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:12469:x1876092385336064:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2870us (3049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.670070:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:1.0:1789181480.672795:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.672921:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385336192 00000100:00100000:0.0:1789181480.672935:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385336192 00010000:00010000:0.0:1789181480.672977:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da7fd9b4/0x76fb555283517fc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df825c expref: 10 pid: 8437 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.673019:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:0.0:1789181480.673029:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2394:x1876092385336192:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181480.673044:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181480.673065:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da7fd9b4/0x76fb555283517fc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df825c expref: 10 pid: 8437 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.673081:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da7fd9b4/0x76fb555283517fc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df825c expref: 10 pid: 8437 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.673108:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da7fd9b4/0x76fb555283517fc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df825c expref: 10 pid: 8437 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.673125:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181480.673130:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181480.673139:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.673150:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.673205:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.673238:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1876092408453504:192.168.202.1@tcp:105: 00000100:00100000:0.0:1789181480.673329:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181480.679780:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1876092408453504:192.168.202.1@tcp:105: 00010000:00010000:0.0:1789181480.679819:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181480.679898:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2394:x1876092385336192:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 6869us (7113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.679913:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 101 00000100:00100000:1.0:1789181480.695233:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181480.695843:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385336320 00000100:00100000:3.0:1789181480.695858:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385336320 00002000:00100000:3.0:1789181480.695919:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9c1cc45cf100 x1876092385336320/t0(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:611/0 lens 504/0 e 0 to 0 dl 1789181491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181480.695931:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc45cf100 with x1876092385336320 ext(0->12) 00002000:00010000:3.0:1789181480.695938:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1cc45cf100 00000100:00100000:3.0:1789181480.696031:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1789181480.696043:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2393:x1876092385336320:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789181480.702082:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:2393:x1876092385336320:12345-192.168.202.1@tcp:4:lhsmtool_posix.0 Request processed in 6021us (6843us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789181480.702103:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00002000:00100000:3.0:1789181480.702123:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9c1cc45cf100 x1876092385336320/t4294967322(0) o4->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:611/0 lens 504/448 e 0 to 0 dl 1789181491 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789181480.702135:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc45cf100 with x1876092385336320 ext(0->12) 00002000:00010000:3.0:1789181480.702144:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1cc45cf100 00000100:00100000:2.0:1789181480.708050:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181480.708401:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385336448 00000100:00100000:3.0:1789181480.708411:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385336448 00000100:00100000:3.0:1789181480.708516:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 243 00000100:00100000:3.0:1789181480.708527:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+73:12469:x1876092385336448:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789181480.710283:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1789181480.710302:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:1.0:1789181480.710342:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789181480.710363:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c1dc7120cc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789181480.710368:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1dfb225700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c1dc7120e40 00000020:00080000:1.0:1789181480.710371:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1dfb225800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c1cc246bc00 00000004:00080000:1.0:1789181480.710408:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1789181480.710433:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c1cc3859300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789181480.710446:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1cc34d9b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c1cc38596c0 00000020:00080000:1.0:1789181480.710449:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1cc34d9600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c1cc3b3e800 00000020:00080000:1.0:1789181480.710462:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1789181480.710530:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789181480.710585:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789181480.710601:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408453632:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789181480.710679:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181480.710716:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181480.710721:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408453760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789181480.710838:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181480.710862:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408453888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789181480.710884:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181480.710916:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408453632 00000100:00100000:1.0:1789181480.710923:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408453632 00000100:00100000:1.0:1789181480.710969:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408453760 00000100:00100000:1.0:1789181480.710972:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408453760 00000100:00100000:1.0:1789181480.710980:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408453888 00000100:00100000:1.0:1789181480.710982:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408453888 00000100:00100000:1.0:1789181480.710995:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789181480.711004:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408453632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789181480.711031:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1789181480.711062:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711085:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ba7da7c/0x76fb555283517d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81bb expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711106:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789181480.711111:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181480.711116:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711142:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ba7da7c/0x76fb555283517d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81bb expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711156:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ba7da7c/0x76fb555283517d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81bb expref: 10 pid: 8437 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181480.711168:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408454016:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181480.711221:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1540 going to sleep for 11 seconds 00000100:00080000:1.0:1789181480.711233:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181480.711245:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789181480.711252:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408453760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789181480.711345:0:8629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789181480.711349:0:8629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789181480 00002000:00010000:1.0:1789181480.711351:0:8629:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789181480.711354:0:8629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789181480 -> 1789181480 00002000:00010000:1.0:1789181480.711356:0:8629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789181480.711393:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1876092408453760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (553us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789181480.711400:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789181480.711421:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789181480.711427:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3643:x1876092408453888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789181480.711437:0:8629:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1789181480.711458:0:8629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4be26, atime: 0x6aa4be27, ctime: 0x6aa4be26, blocks: 0x8 00010000:00010000:1.0:1789181480.711464:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283517fd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711473:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1789181480.711476:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181480.711481:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283517fd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711496:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283517fd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711505:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283517fd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711512:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283517fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711528:0:8629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789181480.711656:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3643:x1876092408453888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 229us (770us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789181480.711662:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:1.0:1789181480.711677:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181480.711683:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283517fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711696:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181480.711701:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283517fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.711711:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283517fd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712031:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712039:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712045:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712050:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181480.712054:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712060:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712082:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c1dfadc6c00) 00010000:00010000:3.0:1789181480.712085:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181480.712090:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712096:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517cd0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712124:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712130:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712136:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712141:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ee00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181480.712143:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712149:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712157:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c1dfadc6700) 00010000:00010000:3.0:1789181480.712159:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181480.712161:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712166:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517d78 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712192:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712198:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712203:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712209:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181480.712212:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712218:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712226:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dd10ab800) 00010000:00010000:3.0:1789181480.712229:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181480.712232:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712237:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b400/0x76fb555283517df6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712249:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712255:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712260:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712272:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181480.712275:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712281:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712290:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dd10ab800) 00010000:00010000:3.0:1789181480.712292:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181480.712294:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712301:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283517e19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712318:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712324:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712330:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712335:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181480.712337:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712343:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712363:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:3.0:1789181480.712365:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181480.712369:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712374:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283517eeb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712386:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712393:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712398:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712404:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181480.712407:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712413:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712420:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:3.0:1789181480.712423:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789181480.712426:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.712432:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283517fa8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.715337:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283517fd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.715358:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283517fd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.715386:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181480.715388:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181480.715391:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789181480.715661:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1cc45ced80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789181480.715670:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408453888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789181480.715701:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:1.0:1789181480.715706:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1789181480.717947:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:12469:x1876092385336448:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 9412us (9898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181480.717961:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 243 00000100:00100000:1.0:1789181480.718147:0:3645:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c1cc4471c00 x1876092408453760/t4294967323(4294967323) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789181496 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789181480.718165:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1cc4471c00/2, rc 0, transno 4294967323 00000100:00100000:1.0:1789181480.718171:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408453760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789181480.719108:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408454144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181480.719176:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181480.719236:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408454144 00000100:00100000:0.0:1789181480.719244:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408454144 00000100:00100000:0.0:1789181480.719303:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789181480.719311:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408454144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181480.719335:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50761408 pending 28672 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789181480.719376:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408454144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.719383:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789181480.719427:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408454144:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789181480.719791:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789181480.724789:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1789181480.724821:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1789181480.726447:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181480.726487:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408454272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181480.726562:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181480.726683:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408454272 00000100:00100000:0.0:1789181480.726692:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408454272 00000100:00100000:0.0:1789181480.726784:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789181480.726811:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876092408454272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181480.726842:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50761408 pending 28672 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789181480.726897:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876092408454272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.726903:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789181480.728670:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408454272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181480.728706:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408454400:0@lo:400:kworker.0 00000100:00100000:1.0:1789181480.728780:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408454656:0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.728788:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181480.728826:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181480.728828:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408454912:0@lo:400:kworker.0 00000100:00100000:1.0:1789181480.728858:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408455168:0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.728860:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181480.728890:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181480.728898:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408455424:0@lo:400:kworker.0 00000100:00100000:1.0:1789181480.728915:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789181480.728925:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408454528:0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.728927:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181480.728950:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789181480.728958:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408454784:0@lo:400:kworker.0 00000100:00100000:1.0:1789181480.728959:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181480.728988:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408455040:0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.728992:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181480.729017:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408455296:0@lo:400:kworker.0 00000100:00100000:1.0:1789181480.729024:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181480.729045:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181480.729065:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408455168 00000100:00100000:1.0:1789181480.729071:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408455168 00000100:00100000:3.0:1789181480.729076:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408454400 00000100:00100000:3.0:1789181480.729082:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408454400 00000100:00100000:1.0:1789181480.729117:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789181480.729122:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789181480.729129:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408455168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.729134:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408454400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.729184:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408454400:12345-0@lo:400:kworker.0 Request processed in 55us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181480.729191:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789181480.729204:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408455168:12345-0@lo:400:kworker.0 Request processed in 78us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181480.729211:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789181480.729226:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408454784 00000100:00100000:3.0:1789181480.729231:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408454784 00000100:00100000:1.0:1789181480.729245:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408455168:0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.729264:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789181480.729274:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408454784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181480.729277:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408454656 00000100:00100000:1.0:1789181480.729282:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408454656 00000100:00100000:1.0:1789181480.729305:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408454912 00000100:00100000:1.0:1789181480.729308:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408454912 00000100:00100000:3.0:1789181480.729313:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408454784:12345-0@lo:400:kworker.0 Request processed in 41us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181480.729329:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:1.0:1789181480.729332:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181480.729350:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408455424 00000100:00100000:1.0:1789181480.729354:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408455424 00000100:00100000:3.0:1789181480.729367:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408454784:0@lo:400:kworker.0 00000100:00080000:1.0:1789181480.729369:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181480.729384:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408454400:0@lo:400:kworker.0 00000100:00100000:1.0:1789181480.729385:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408454528 00000100:00100000:1.0:1789181480.729391:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408454528 00000100:00100000:1.0:1789181480.729408:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408455040 00000100:00100000:1.0:1789181480.729411:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408455040 00000100:00100000:3.0:1789181480.729417:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408455296 00000100:00100000:3.0:1789181480.729422:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408455296 00000100:00080000:1.0:1789181480.729433:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181480.729438:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181480.729449:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789181480.729458:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408454656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.729491:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408454656:12345-0@lo:400:kworker.0 Request processed in 36us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181480.729974:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789181480.729986:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408454912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181480.730039:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408454912:12345-0@lo:400:kworker.0 Request processed in 56us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181480.730151:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789181480.730189:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408454656:0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.730215:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408454912:0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.730232:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789181480.730239:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408455424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.730277:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408455424:12345-0@lo:400:kworker.0 Request processed in 39us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181480.730283:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00080000:3.0:1789181480.730319:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3896d80 x1876092408455424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181480.730330:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408455424:0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.730348:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789181480.730355:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408454528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.731324:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408454528:12345-0@lo:400:kworker.0 Request processed in 968us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181480.731332:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789181480.731379:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408454528:0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.731403:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789181480.731411:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408455296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.731439:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408455296:12345-0@lo:400:kworker.0 Request processed in 30us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181480.731445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789181480.731484:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408455296:0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.731513:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789181480.731521:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408455040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181480.731552:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408455040:12345-0@lo:400:kworker.0 Request processed in 33us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181480.731558:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00080000:3.0:1789181480.731580:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3894380 x1876092408455040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181480.731591:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408455040:0@lo:400:kworker.0 00000100:00100000:0.0:1789181480.731923:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1876092408454016:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181480.731944:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.731980:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.732000:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385336704 00000100:00100000:0.0:1789181480.732007:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385336704 00010000:00010000:0.0:1789181480.732035:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ba7da7c/0x76fb555283517d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81bb expref: 11 pid: 8437 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.732058:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 102 00000100:00100000:0.0:1789181480.732065:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+11:2393:x1876092385336704:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181480.732076:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181480.732082:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ba7da7c/0x76fb555283517d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81bb expref: 11 pid: 8437 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732095:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ba7da7c/0x76fb555283517d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81bb expref: 11 pid: 8437 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732122:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ba7da7c/0x76fb555283517d86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df81bb expref: 11 pid: 8437 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732153:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181480.732159:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181480.732166:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732175:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732198:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181480.732239:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2393:x1876092385336704:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 174us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.732245:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 102 00010000:00010000:0.0:1789181480.732264:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732272:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732282:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732290:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732305:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789181480.732644:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1876092408453632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21640us (21963us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789181480.732653:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1789181480.732852:0:13192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181480.732859:0:13192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732869:0:13192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181480.732874:0:13192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732884:0:13192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732897:0:13192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732904:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000831ac6ac/0x76fb555283517fd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.732922:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181480.732924:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181480.732926:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181480.733010:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.733081:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385336576 00000100:00100000:0.0:1789181480.733086:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385336576 00000100:00100000:0.0:1789181480.733118:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:0.0:1789181480.733126:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+10:2393:x1876092385336576:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1789181480.733246:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1cc4472a00/2, rc 0, transno 4294967324 00000100:00100000:0.0:1789181480.733253:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408453632:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789181480.734667:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000001:00080000:0.0:1789181480.735791:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1789181480.735806:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:2.0:1789181480.735986:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385336576:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 2854us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181480.735999:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:0.0:1789181480.742477:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181480.742579:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385336960 00000100:00100000:3.0:1789181480.742592:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385336960 00000100:00100000:3.0:1789181480.742665:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 244 00000100:00100000:3.0:1789181480.742675:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:12469:x1876092385336960:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789181480.742780:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181480.742831:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1400/0x76fb555283517fbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8255 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.742854:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:3.0:1789181480.742860:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181480.742898:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.742914:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.742924:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181480.743070:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a02709a7 reply state 0000000061389900 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.743083:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181480.743089:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:3.0:1789181480.743091:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181480.743094:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181480.743234:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:12469:x1876092385336960:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 559us (782us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1789181480.743243:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 244 00000100:00100000:0.0:1789181480.750859:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.751013:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385337088 00000100:00100000:1.0:1789181480.751026:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385337088 00000100:00100000:1.0:1789181480.751086:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:1.0:1789181480.751098:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385337088:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789181480.751292:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789181480.751297:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789181480 -> 1789181479 00002000:00010000:1.0:1789181480.751299:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789181479 00002000:00010000:1.0:1789181480.751301:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789181480 -> 1789181479 00002000:00010000:1.0:1789181480.751304:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789181480.751380:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385337088:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 284us (533us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789181480.751388:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 78 00000100:00100000:2.0:1789181480.753520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.753620:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385337344 00000100:00100000:0.0:1789181480.753629:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385337344 00000100:00100000:0.0:1789181480.753687:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 245 00000100:00100000:0.0:1789181480.753696:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:12469:x1876092385337344:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789181480.753798:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.753817:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8247 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.753827:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.753864:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8247 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.753880:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8247 expref: 22 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.753896:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408455552:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181480.753967:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181480.761902:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408455552:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181480.761948:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181480.765118:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.765231:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385337472 00000100:00100000:1.0:1789181480.765242:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385337472 00010000:00010000:1.0:1789181480.765295:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8247 expref: 23 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181480.765348:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 103 00000100:00100000:1.0:1789181480.765359:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+23:2393:x1876092385337472:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181480.765375:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181480.765397:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8247 expref: 23 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.765409:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8247 expref: 23 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.765434:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1800/0x76fb555283517fa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8247 expref: 23 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.765450:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:1.0:1789181480.765455:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.765476:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.765485:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.765523:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181480.765589:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:2393:x1876092385337472:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 232us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181480.765596:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 103 00010000:00010000:2.0:1789181480.765765:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.765773:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.765809:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.765817:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.765823:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.765841:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181480.765845:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.765854:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.765863:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:2.0:1789181480.765866:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789181480.765870:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.765875:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0600/0x76fb555283517fe7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181480.765915:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:12469:x1876092385337344:12345-192.168.202.1@tcp:55:lhsmtool_posix.0 Request processed in 12220us (12406us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789181480.765924:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 245 00000100:00100000:2.0:1789181480.769585:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.769702:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385337600 00000100:00100000:0.0:1789181480.769712:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385337600 00000100:00100000:0.0:1789181480.769797:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:0.0:1789181480.769808:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385337600:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789181480.769858:0:8629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.769883:0:8629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.769894:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181480.769900:0:8629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181480.769906:0:8629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.769951:0:8629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.769967:0:8629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 8 pid: 8435 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.769982:0:8629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8629:1876092408455680:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181480.770085:0:8629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181480.773229:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.773338:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385337728 00000100:00100000:1.0:1789181480.773348:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385337728 00010000:00010000:1.0:1789181480.773394:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 9 pid: 8435 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181480.773439:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 104 00000100:00100000:1.0:1789181480.773467:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2394:x1876092385337728:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181480.773900:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181480.773924:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 9 pid: 8435 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.773939:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 9 pid: 8435 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.773963:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181480.773967:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181480.773974:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.773985:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.774006:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181480.774052:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+9:2394:x1876092385337728:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 604us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181480.774060:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 104 00010000:00010000:0.0:1789181480.774384:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f81cfba6/0x76fb555283517fcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8263 expref: 8 pid: 8435 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.774403:0:8629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8629:1876092408455680:192.168.202.1@tcp:104: 00010000:00010000:0.0:1789181480.774429:0:8629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.774439:0:8629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.774447:0:8629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.774469:0:8629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.774478:0:8629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.774486:0:8629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.774493:0:8629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1e00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181480.774497:0:8629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.774518:0:8629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.774531:0:8629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.774540:0:8629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ca7e74/0x76fb555283517fee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.774604:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385337600:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 4798us (5029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.774621:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 79 00000100:00100000:3.0:1789181480.778096:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.778445:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385337984 00000100:00100000:1.0:1789181480.778472:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385337984 00000100:00100000:1.0:1789181480.778535:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 246 00000100:00100000:1.0:1789181480.778545:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:12469:x1876092385337984:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789181480.778632:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.778651:0:9021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df820f expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.778673:0:9021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.778712:0:9021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df820f expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.778746:0:9021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df820f expref: 21 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181480.778760:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408455808:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181480.778855:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181480.785215:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408455808:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181480.785249:0:9021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181480.786027:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.786118:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385338112 00000100:00100000:1.0:1789181480.786127:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385338112 00010000:00010000:1.0:1789181480.786162:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df820f expref: 22 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181480.786204:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 105 00000100:00100000:1.0:1789181480.786213:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:2394:x1876092385338112:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181480.786228:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181480.786235:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df820f expref: 22 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.786265:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df820f expref: 22 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.786287:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0c00/0x76fb555283517ee4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df820f expref: 22 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.786312:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:1.0:1789181480.786319:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517f46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8232 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.786330:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.786337:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.786346:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.786371:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181480.786423:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:2394:x1876092385338112:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 211us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181480.786430:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 105 00010000:00010000:2.0:1789181480.786560:0:9021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.786569:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.786794:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.786807:0:9021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517faf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df824e expref: 21 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.786826:0:9021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.786855:0:9021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517faf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df824e expref: 21 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.786869:0:9021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517faf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df824e expref: 21 pid: 9021 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181480.786882:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408455936:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181480.786932:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7120000 going to sleep for 11 seconds 00000100:00100000:1.0:1789181480.793425:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408455936:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181480.793476:0:9021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181480.794512:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.794658:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385338240 00000100:00100000:1.0:1789181480.794683:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385338240 00010000:00010000:1.0:1789181480.794759:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517faf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df824e expref: 22 pid: 9021 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181480.794802:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 106 00000100:00100000:1.0:1789181480.794812:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:2393:x1876092385338240:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181480.794829:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181480.794836:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517faf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df824e expref: 22 pid: 9021 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.794849:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517faf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df824e expref: 22 pid: 9021 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.794872:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1000/0x76fb555283517faf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df824e expref: 22 pid: 9021 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.794889:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:1.0:1789181480.794894:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.794904:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.794912:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.794941:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181480.794990:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:2393:x1876092385338240:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 179us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181480.795006:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 106 00010000:00010000:2.0:1789181480.795403:0:9021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.795413:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181480.795540:0:9021:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1789181480.795661:0:9021:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1789181480.795697:0:9021:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789181480.795829:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9021:1876092408456064:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789181480.795886:0:9021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181480.795921:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc3c47c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181480.796049:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408456064 00000100:00100000:3.0:1789181480.796065:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408456064 00000100:00100000:3.0:1789181480.796112:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789181480.796120:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9021:x1876092408456064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789181480.796222:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9021:x1876092408456064:12345-0@lo:1000:mdt00_003.0 Request processed in 102us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181480.796230:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789181480.796638:0:9021:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789181480.796646:0:9021:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1cc4471c00, transno 4294967323 00000004:00080000:2.0:1789181480.796654:0:9021:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1cc4472a00, transno 4294967324 00000100:00100000:2.0:1789181480.796662:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9021:1876092408456064:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789181480.797012:0:9021:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1789181480.797059:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9021:1876092408456192:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789181480.797094:0:9021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181480.797110:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7120f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181480.797163:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408456192 00000100:00100000:0.0:1789181480.797168:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408456192 00000100:00100000:0.0:1789181480.797217:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789181480.797225:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9021:x1876092408456192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789181480.797326:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9021:x1876092408456192:12345-0@lo:1000:mdt00_003.0 Request processed in 101us (230us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789181480.797333:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789181480.797680:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9021:1876092408456192:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789181480.797719:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.797953:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.797961:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.797969:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084aa00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181480.797973:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.797981:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.797996:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:2.0:1789181480.797999:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181480.798003:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.798010:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283517ffc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.798033:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.798049:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.798055:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.798060:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181480.798063:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.798069:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.798076:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181480.798078:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181480.798085:0:9021:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517f46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8232 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.798097:0:9021:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517f46 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8232 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.798106:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517f46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8232 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.798136:0:9021:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517f46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8232 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181480.798148:0:9021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408456320:192.168.202.1@tcp:105: 00000100:00100000:2.0:1789181480.801145:0:9021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd60f5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181480.808192:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181480.808313:0:9021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9021:1876092408456320:192.168.202.1@tcp:105: 00010000:00010000:2.0:1789181480.808348:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808360:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12c00/0x76fb555283517f3f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808410:0:9021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518003 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808429:0:9021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518003 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808443:0:9021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518003 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808455:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518003 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808461:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518003 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808467:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518003 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808472:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084aa00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181480.808477:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518003 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808485:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518003 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808520:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181480.808523:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181480.808527:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518003 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808532:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518003 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808542:0:9021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808548:0:9021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808552:0:9021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808556:0:9021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181480.808560:0:9021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808565:0:9021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808571:0:9021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181480.808573:0:9021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789181480.808576:0:9021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.808581:0:9021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13000/0x76fb555283517ff5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9021 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181480.808819:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:12469:x1876092385337984:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 30272us (30730us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789181480.808830:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 246 00000020:00080000:2.0:1789181480.808837:0:9021:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789181480.808994:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385338368 00000100:00100000:1.0:1789181480.809004:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385338368 00000100:00100000:1.0:1789181480.809055:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1789181480.809066:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:12468:x1876092385338368:12345-192.168.202.1@tcp:49:lfs.0 00000100:00100000:1.0:1789181480.809175:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:12468:x1876092385338368:12345-192.168.202.1@tcp:49:lfs.0 Request processed in 112us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181480.809182:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000040:00080000:3.0:1789181480.809250:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181480.809255:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181480.810618:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789181480.810633:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181480.812713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181480.816263:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.816384:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385338880 00000100:00100000:1.0:1789181480.816395:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385338880 00000100:00100000:1.0:1789181480.816460:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:1.0:1789181480.816471:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd13d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+24:12469:x1876092385338880:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789181480.816825:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789181480.816865:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1789181480.816898:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.816915:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.816927:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.816936:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.816943:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.816966:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181480.816978:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789181480.817071:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd13d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+26:12469:x1876092385338880:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 601us (819us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789181480.817080:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000020:00080000:1.0:1789181480.817085:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789181480.817288:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181480.817296:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.817304:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181480.817314:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.817321:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.817334:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:0.0:1789181480.817337:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789181480.817341:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.817347:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb55528351800a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.817358:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181480.817360:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181480.817362:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181480.817629:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385338624 00000100:00100000:2.0:1789181480.817636:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385338624 00000100:00100000:2.0:1789181480.817681:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 247 00000100:00100000:2.0:1789181480.817690:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+26:12468:x1876092385338624:12345-192.168.202.1@tcp:58:lfs.0 00000040:00080000:2.0:1789181480.817846:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789181480.817896:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+26:12468:x1876092385338624:12345-192.168.202.1@tcp:58:lfs.0 Request processed in 208us (5192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181480.817903:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 247 00000100:00100000:3.0:1789181480.865987:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181480.866104:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385339008 00000100:00100000:2.0:1789181480.866115:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385339008 00000100:00100000:2.0:1789181480.866198:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 248 00000100:00100000:2.0:1789181480.866209:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+26:12471:x1876092385339008:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181480.866236:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181480.866259:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518011 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df826a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866323:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283518018 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866339:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283518018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866351:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283518018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866392:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351801f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866400:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351801f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866406:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351801f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866483:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866494:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df822b expref: 27 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866502:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866534:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df822b expref: 27 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.866546:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df822b expref: 27 pid: 9021 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181480.866560:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408456448:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181480.866690:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd60f5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181480.868945:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181480.869016:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385339264 00000100:00100000:1.0:1789181480.869027:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385339264 00000100:00100000:1.0:1789181480.869088:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1789181480.869100:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+28:6167:x1876092385339264:12345-192.168.202.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789181480.869382:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:6167:x1876092385339264:12345-192.168.202.1@tcp:35:ldlm_bl.0 Request processed in 282us (446us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789181480.869390:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1789181480.869949:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1876092408456448:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181480.869982:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181480.871659:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181480.871747:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385339392 00000100:00100000:0.0:1789181480.871757:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385339392 00010000:00010000:0.0:1789181480.871798:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df822b expref: 29 pid: 9021 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181480.871842:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 107 00000100:00100000:0.0:1789181480.871852:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd63d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:2393:x1876092385339392:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181480.871865:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181480.871872:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df822b expref: 29 pid: 9021 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.871884:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df822b expref: 29 pid: 9021 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.871923:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0000/0x76fb555283517f31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df822b expref: 29 pid: 9021 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.871939:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:0.0:1789181480.871944:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.871953:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.871960:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181480.871989:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181480.872047:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd63d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+28:2393:x1876092385339392:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 196us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181480.872054:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 107 00010000:00010000:2.0:1789181480.872152:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872161:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181480.872228:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789181480.872233:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181480.872252:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872265:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872274:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283518018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872281:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283518018 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872287:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283518018 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872293:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181480.872297:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283518018 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872305:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283518018 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872314:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:2.0:1789181480.872323:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181480.872327:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283518018 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872333:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b600/0x76fb555283518018 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872343:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351801f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872350:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351801f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872356:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351801f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872360:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181480.872363:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351801f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872383:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351801f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872390:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c1dc7121500) 00010000:00010000:2.0:1789181480.872392:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181480.872395:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351801f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872401:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb55528351801f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872436:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084aa00/0x76fb555283518011 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df826a expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872462:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df826a expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181480.872468:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181480.872470:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181480.872472:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084ac00, rc 0) 00000100:00100000:2.0:1789181480.872496:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:12471:x1876092385339008:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 6290us (6521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181480.872503:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 248 00010000:00010000:1.0:1789181481.547831:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181481.870578:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181481.870588:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789181481.870626:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789181481.870635:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181481.870821:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408456576:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789181481.870930:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd60f56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181481.875860:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876092408456576:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789181481.876497:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181481.877773:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385339520 00000100:00100000:3.0:1789181481.877786:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385339520 00000100:00100000:3.0:1789181481.877849:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 249 00000100:00100000:3.0:1789181481.877860:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:12482:x1876092385339520:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789181481.877896:0:9021:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789181481.878009:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:12482:x1876092385339520:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 150us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181481.878016:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 249 00000100:00080000:1.0:1789181481.878148:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181481.897575:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181481.897662:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385339776 00000100:00100000:0.0:1789181481.897672:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385339776 00000100:00100000:0.0:1789181481.897775:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00100000:0.0:1789181481.897785:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+27:12482:x1876092385339776:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181481.897807:0:14725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181481.897828:0:14725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351802d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8271 expref: -99 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181481.897938:0:14725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283518034 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181481.897967:0:14725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283518034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181481.897980:0:14725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283518034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181481.897992:0:14725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789181481.898099:0:14725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f1c00/0x76fb55528351802d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8271 expref: 30 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181481.898117:0:14725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283518034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8271 expref: 29 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181481.898125:0:14725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:0.0:1789181481.898128:0:14725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181481.898132:0:14725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0800, rc 0) 00000100:00100000:0.0:1789181481.898187:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:12482:x1876092385339776:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 403us (623us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789181481.898194:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 250 00000100:00100000:2.0:1789181481.912068:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181481.912117:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181481.912163:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385340032 00000100:00100000:2.0:1789181481.912175:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385340032 00000100:00100000:2.0:1789181481.912243:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:2.0:1789181481.912255:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:12482:x1876092385340032:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789181481.912343:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518042 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181481.912441:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181481.912471:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181481.912931:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518042 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181481.912941:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518042 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181481.912949:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518042 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181481.912956:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181481.912961:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518042 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181481.912969:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518042 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181481.912982:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181481.912985:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789181481.912990:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518042 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181481.912996:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518042 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181481.913848:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385340160 00000100:00100000:1.0:1789181481.913859:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385340160 00000100:00100000:1.0:1789181481.913918:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:1.0:1789181481.913929:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+31:2393:x1876092385340160:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181481.913944:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181481.913965:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0800/0x76fb555283518034 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8271 expref: 31 pid: 14725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181481.913993:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:1.0:1789181481.913997:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181481.914059:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:2393:x1876092385340160:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 132us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181481.914068:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000040:00080000:1.0:1789181481.920884:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181481.920893:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181481.921471:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789181481.921482:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181481.922475:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:12482:x1876092385340032:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 10213us (10414us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789181481.922488:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 251 00000100:00100000:2.0:1789181481.926096:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181481.927141:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385340416 00000100:00100000:0.0:1789181481.927153:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385340416 00000100:00100000:0.0:1789181481.927210:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1789181481.927221:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+29:12482:x1876092385340416:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789181481.927465:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:12482:x1876092385340416:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 245us (1376us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789181481.927473:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000040:00080000:1.0:1789181482.005070:0:14763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181482.005081:0:14763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181482.005153:0:14763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789181482.005162:0:14763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789181482.246146:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181482.246269:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385340672 00000100:00100000:3.0:1789181482.246283:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385340672 00000100:00100000:3.0:1789181482.246357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:3.0:1789181482.246369:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+30:12495:x1876092385340672:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181482.246412:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181482.246434:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283518049 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8278 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181482.246963:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518050 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181482.246990:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518050 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181482.247004:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518050 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181482.247018:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789181482.247152:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e000/0x76fb555283518049 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8278 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181482.247172:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518050 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8278 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181482.247180:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181482.247183:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789181482.247187:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a800, rc 0) 00000100:00100000:2.0:1789181482.247252:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:12495:x1876092385340672:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 885us (1119us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789181482.247260:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 252 00000100:00100000:0.0:1789181482.249357:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181482.249430:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385340800 00000100:00100000:3.0:1789181482.249441:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385340800 00000100:00100000:3.0:1789181482.249555:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:3.0:1789181482.249576:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:12495:x1876092385340800:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1789181482.249648:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351805e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181482.249663:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351805e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181482.249674:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351805e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181482.249708:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351805e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181482.249714:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351805e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181482.249752:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351805e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181482.249760:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e200 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181482.249765:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351805e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181482.249773:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351805e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181482.249800:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:3.0:1789181482.249804:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181482.249809:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351805e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181482.249815:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085e200/0x76fb55528351805e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181482.250043:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:12495:x1876092385340800:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 467us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181482.250052:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 253 00000100:00100000:1.0:1789181482.413225:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181482.414199:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385340928 00000100:00100000:2.0:1789181482.414215:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385340928 00000100:00100000:2.0:1789181482.414303:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00100000:2.0:1789181482.414317:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2394:x1876092385340928:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:2.0:1789181482.414352:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181482.414377:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa6e3e49/0x76fb555283518065 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df827f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181482.414405:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa4be27, atime: 0x6aa4be27, ctime: 0x6aa4be27, blocks: 0x8 00010000:00010000:2.0:1789181482.414429:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=438s v=(0 0) 00010000:00010000:2.0:1789181482.414433:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181482.414443:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6e3e49/0x76fb555283518065 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df827f expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181482.414471:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa6e3e49/0x76fb555283518065 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df827f expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181482.414484:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b600, rc 0) 00000100:00100000:2.0:1789181482.414560:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385340928:12345-192.168.202.1@tcp:101:cat.0 Request processed in 246us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181482.414567:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 80 00000100:00080000:1.0:1789181482.414705:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181482.420698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181482.422695:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385341056 00000100:00100000:3.0:1789181482.422859:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385341056 00002000:00100000:2.0:1789181482.423194:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9c1cc46bdc00 x1876092385341056/t0(0) o3->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:613/0 lens 488/0 e 0 to 0 dl 1789181493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181482.423206:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc46bdc00 with x1876092385341056 ext(0->4095) 00002000:00010000:2.0:1789181482.423213:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1cc46bdc00 00000100:00100000:2.0:1789181482.423298:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1789181482.423310:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385341056:12345-192.168.202.1@tcp:3:cat.0 00000100:00100000:2.0:1789181482.423751:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2393:x1876092385341056:12345-192.168.202.1@tcp:3:cat.0 Request processed in 442us (3061us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789181482.423768:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00002000:00100000:2.0:1789181482.423777:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9c1cc46bdc00 x1876092385341056/t0(0) o3->3c4ab02e-ed68-4ee0-b458-d9073baffb59@192.168.202.1@tcp:613/0 lens 488/4536 e 0 to 0 dl 1789181493 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181482.423786:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c1cc46bdc00 with x1876092385341056 ext(0->4095) 00002000:00010000:2.0:1789181482.423790:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c1cc46bdc00 00010000:00010000:2.0:1789181482.572246:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181482.764220:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408456704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181482.764293:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181482.766285:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408456704 00000100:00100000:3.0:1789181482.766300:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408456704 00000100:00100000:3.0:1789181482.766365:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789181482.766375:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408456704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181482.766415:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789181482.766520:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408456704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181482.766527:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789181482.766996:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408456704:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789181483.598125:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789181483.598834:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181483.981102:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181483.981115:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181483.981139:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789181483.981148:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181484.300559:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181484.300594:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408456832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181484.300677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181484.302254:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408456832 00000100:00100000:0.0:1789181484.302277:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408456832 00000100:00100000:0.0:1789181484.302373:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789181484.302386:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408456832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181484.302423:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181484.302519:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408456832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181484.302526:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789181484.302591:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789181484.302598:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:0.0:1789181484.302639:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1cc37c4a80, transno 4294967308 00000004:00080000:0.0:1789181484.302662:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1789181484.302676:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1cc45ced80, transno 4294967311 00000100:00100000:0.0:1789181484.302688:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408456832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181484.303403:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181484.303418:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408456960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181484.303476:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181484.303527:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408456960 00000100:00100000:3.0:1789181484.303533:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408456960 00000100:00100000:3.0:1789181484.303591:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789181484.303599:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408456960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181484.303615:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789181484.303664:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408456960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181484.303683:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789181484.303761:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408456960:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789181484.304845:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181484.391242:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181484.391294:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181484.391324:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181484.391352:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181484.391374:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181484.391390:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181484.391413:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181484.391798:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385341440 00000100:00100000:0.0:1789181484.391809:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385341440 00000100:00100000:0.0:1789181484.391882:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385341952 00000100:00100000:0.0:1789181484.391885:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385341952 00000100:00100000:0.0:1789181484.391898:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385341312 00000100:00100000:0.0:1789181484.391900:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385341312 00000100:00100000:0.0:1789181484.391913:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385341824 00000100:00100000:0.0:1789181484.391915:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385341824 00000100:00100000:0.0:1789181484.391932:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 350 00000100:00100000:0.0:1789181484.391940:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385341440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181484.392425:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385341440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 484us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181484.392434:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 350 00000100:00100000:0.0:1789181484.392454:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 351 00000100:00100000:0.0:1789181484.392462:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385341952:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181484.392488:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385341952:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181484.392495:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 351 00000100:00100000:0.0:1789181484.392507:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 352 00000100:00100000:0.0:1789181484.392514:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:2394:x1876092385341312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181484.392661:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385341184 00000100:00100000:1.0:1789181484.392667:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385341184 00000100:00100000:1.0:1789181484.392706:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 394 00000100:00100000:1.0:1789181484.392714:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385341184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181484.392761:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385341184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 48us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181484.392778:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 394 00000100:00100000:1.0:1789181484.392824:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385341696 00000100:00100000:1.0:1789181484.392829:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385341696 00000100:00100000:1.0:1789181484.392860:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385341568 00000100:00100000:1.0:1789181484.392864:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385341568 00000100:00100000:1.0:1789181484.392888:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:1.0:1789181484.392895:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385341696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181484.392922:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+8:2394:x1876092385341696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181484.392929:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:1.0:1789181484.392941:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:1.0:1789181484.392961:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385341568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181484.392986:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385341568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181484.392992:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:1.0:1789181484.393012:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 353 00000100:00100000:1.0:1789181484.393019:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385341824:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181484.393262:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2394:x1876092385341824:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181484.393334:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 353 00000100:00080000:1.0:1789181484.393366:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181484.393370:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181484.393372:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181484.393374:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181484.394683:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+32:2394:x1876092385341312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181484.394709:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 352 00010000:00010000:1.0:1789181484.622020:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181485.325027:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181485.325052:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408457088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181485.325122:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181485.325214:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408457088 00000100:00100000:1.0:1789181485.325221:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408457088 00000100:00100000:1.0:1789181485.325267:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789181485.325276:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408457088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181485.325310:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789181485.325368:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408457088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181485.325376:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789181485.325425:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408457088:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789181485.650105:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181485.835893:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181485.835915:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408457216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181485.835984:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181485.836059:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408457216 00000100:00100000:0.0:1789181485.836068:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408457216 00000100:00100000:0.0:1789181485.836121:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789181485.836130:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408457216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181485.836157:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789181485.836205:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408457216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181485.836211:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1789181485.836232:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181485.836266:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408457216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181485.836660:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408457472:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.836695:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181485.836719:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408457984:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.836756:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181485.836773:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408458496:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.836793:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181485.836903:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408457728:0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.836941:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181485.836962:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408458240:0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.836984:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181485.837004:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789181485.837010:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408457344:0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.837037:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181485.837062:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408457856:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.839056:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789181485.839078:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408457600:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.839137:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181485.841184:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181485.841212:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408458752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181485.841282:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181485.841340:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408458752 00000100:00100000:0.0:1789181485.841348:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408458752 00000100:00100000:0.0:1789181485.841408:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789181485.841418:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408458752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181485.841444:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789181485.841492:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408458752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181485.841498:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1789181485.841521:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181485.841574:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408458752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181485.843067:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408458240 00000100:00100000:3.0:1789181485.843081:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408458240 00000100:00100000:3.0:1789181485.843140:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789181485.843150:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408458240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181485.843224:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408458240:12345-0@lo:400:kworker.0 Request processed in 75us (6238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181485.843231:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789181485.843254:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408457728 00000100:00100000:3.0:1789181485.843257:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408457728 00000100:00100000:3.0:1789181485.843284:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789181485.843290:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc66d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408457728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181485.843325:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc66d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408457728:12345-0@lo:400:kworker.0 Request processed in 35us (6383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181485.843331:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789181485.843674:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408457344 00000100:00100000:3.0:1789181485.843678:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408457344 00000100:00100000:3.0:1789181485.843701:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789181485.843708:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408457344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181485.843768:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408457344:12345-0@lo:400:kworker.0 Request processed in 60us (6729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181485.843774:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789181485.845326:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408457472 00000100:00100000:2.0:1789181485.845338:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408457472 00000100:00100000:2.0:1789181485.845405:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408457984 00000100:00100000:2.0:1789181485.845409:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408457984 00000100:00100000:2.0:1789181485.845434:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408458496 00000100:00100000:2.0:1789181485.845437:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408458496 00000100:00100000:2.0:1789181485.845449:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408457600 00000100:00100000:2.0:1789181485.845452:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408457600 00000100:00100000:2.0:1789181485.845487:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789181485.845496:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408457472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.845583:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408457472:12345-0@lo:400:kworker.0 Request processed in 88us (8887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181485.845591:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789181485.845612:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789181485.845620:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408457984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.845650:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408457984:12345-0@lo:400:kworker.0 Request processed in 32us (8893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181485.845655:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789181485.845667:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789181485.845674:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408458496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181485.845690:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789181485.845699:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408458496:12345-0@lo:400:kworker.0 Request processed in 26us (8905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181485.845706:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408457600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.845710:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00080000:2.0:1789181485.845750:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181485.845772:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408457600:12345-0@lo:400:kworker.0 Request processed in 71us (6633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181485.845786:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789181485.845872:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181485.845906:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408458368:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.845939:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181485.846044:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408457728:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.846067:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408458240:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.846088:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408457344:0@lo:400:kworker.0 00000100:00100000:0.0:1789181485.846129:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408457856 00000100:00100000:0.0:1789181485.846134:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408457856 00000100:00100000:3.0:1789181485.846274:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408458368 00000100:00100000:3.0:1789181485.846279:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408458368 00000100:00080000:2.0:1789181485.846327:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181485.846373:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408457600:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.846380:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408458112:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.846407:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181485.846423:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408458624:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.846442:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181485.846463:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408458112 00000100:00100000:1.0:1789181485.846466:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408458112 00000100:00100000:1.0:1789181485.846490:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408458624 00000100:00100000:1.0:1789181485.846493:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408458624 00000100:00100000:1.0:1789181485.846510:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789181485.846517:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408458112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.846549:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408458112:12345-0@lo:400:kworker.0 Request processed in 33us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181485.846555:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789181485.846576:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789181485.846581:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408458624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.846605:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408458624:12345-0@lo:400:kworker.0 Request processed in 24us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181485.846610:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789181485.846639:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408458624:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.846650:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408457472:0@lo:400:kworker.0 00010000:00080000:1.0:1789181485.846676:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc3894000 x1876092408457984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181485.846686:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408457984:0@lo:400:kworker.0 00010000:00080000:1.0:1789181485.846697:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093fb80 x1876092408458496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181485.846704:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408458496:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.846745:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408458112:0@lo:400:kworker.0 00000001:00080000:1.0:1789181485.848553:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1789181485.848599:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c1dc2427840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789181485.848604:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1dfb225e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c1dc2427600 00000020:00080000:1.0:1789181485.848608:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c1dfb225f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c1cc25b2400 00000020:00080000:1.0:1789181485.848625:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1789181485.848645:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181485.848657:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181485.848666:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181485.848672:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085ee00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181485.848678:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181485.848686:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181485.848716:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c1dd82e2f00) 00010000:00010000:1.0:1789181485.848719:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181485.848747:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181485.848753:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ee00/0x76fb555283517fe0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789181485.848794:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789181485.848857:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1789181485.851156:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789181485.851184:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408457856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181485.851297:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408457856:12345-0@lo:400:kworker.0 Request processed in 129us (5424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181485.851304:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789181485.851400:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408457856:0@lo:400:kworker.0 00000100:00100000:3.0:1789181485.851935:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789181485.852029:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408458368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181485.852091:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408458368:12345-0@lo:400:kworker.0 Request processed in 147us (6150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181485.852099:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789181485.852309:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408458368:0@lo:400:kworker.0 00010000:00010000:0.0:1789181486.668010:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789181486.871467:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967326 is committed 00000001:00080000:1.0:1789181486.871495:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:2.0:1789181487.707871:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181487.890008:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408458880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181487.890093:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181487.890190:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408458880 00000100:00100000:1.0:1789181487.890198:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408458880 00000100:00100000:1.0:1789181487.890254:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789181487.890265:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408458880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181487.890304:0:7854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789181487.896430:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408458880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6153us (6322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181487.896449:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789181487.899679:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408458880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181487.925861:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181487.925898:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385342080 00000100:00100000:1.0:1789181487.925908:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385342080 00000100:00100000:1.0:1789181487.926045:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00100000:1.0:1789181487.926057:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:12157:x1876092385342080:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789181487.926165:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:12157:x1876092385342080:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 111us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181487.926177:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 254 00000100:00080000:2.0:1789181487.930786:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181487.934908:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181487.936665:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385342208 00000100:00100000:2.0:1789181487.936684:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385342208 00000100:00100000:2.0:1789181487.936782:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00100000:2.0:1789181487.936795:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:12157:x1876092385342208:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789181487.936914:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:12157:x1876092385342208:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 122us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181487.936922:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 255 00000100:00080000:2.0:1789181487.941221:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181487.952987:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181487.953110:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385342464 00000100:00100000:2.0:1789181487.953122:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385342464 00000100:00100000:2.0:1789181487.953184:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1789181487.953195:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:12157:x1876092385342464:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789181487.953444:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:12157:x1876092385342464:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 249us (466us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789181487.953452:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00010000:00010000:3.0:1789181488.720115:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181489.420758:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408459008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181489.420844:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181489.421121:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181489.421129:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408459136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181489.421155:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181489.421193:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408459008 00000100:00100000:1.0:1789181489.421200:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408459008 00000100:00100000:1.0:1789181489.421251:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408459136 00000100:00100000:1.0:1789181489.421255:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408459136 00000100:00100000:1.0:1789181489.421272:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789181489.421279:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408459008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181489.421320:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181489.421362:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408459008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181489.421369:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789181489.421384:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789181489.421390:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408459136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789181489.421401:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181489.421424:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408459136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181489.421444:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1789181489.421460:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181489.421495:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408459136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181489.421539:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408459008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181489.512160:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181489.512204:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181489.512235:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181489.512266:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181489.512288:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181489.512290:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385342976 00000100:00100000:2.0:1789181489.512305:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181489.512314:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385342976 00000100:00100000:2.0:1789181489.512345:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181489.512388:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385343104 00000100:00100000:3.0:1789181489.512392:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385343104 00000100:00100000:3.0:1789181489.512423:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:0.0:1789181489.512431:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385342720 00000100:00100000:3.0:1789181489.512434:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385342976:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181489.512438:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385342720 00000100:00100000:0.0:1789181489.512476:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385343360 00000100:00100000:0.0:1789181489.512480:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385343360 00000100:00100000:0.0:1789181489.512510:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385343232 00000100:00100000:0.0:1789181489.512513:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385343232 00000100:00100000:3.0:1789181489.512518:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385342976:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181489.512534:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385342848 00000100:00100000:3.0:1789181489.512539:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:0.0:1789181489.512539:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385342848 00000100:00100000:3.0:1789181489.512563:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:0.0:1789181489.512567:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 360 00000100:00100000:3.0:1789181489.512573:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385343104:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181489.512579:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:2394:x1876092385342720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181489.512622:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385343104:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 51us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181489.512628:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:0.0:1789181489.512638:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:2394:x1876092385342720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 62us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181489.512646:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 360 00000100:00100000:3.0:1789181489.512663:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 361 00000100:00100000:3.0:1789181489.512673:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385343360:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181489.512679:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 362 00000100:00100000:0.0:1789181489.512689:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385343232:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181489.512705:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385343360:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 34us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181489.512746:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 361 00000100:00100000:0.0:1789181489.512749:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385343232:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181489.512758:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 362 00000100:00100000:3.0:1789181489.512767:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 363 00000100:00100000:3.0:1789181489.512776:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385342848:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181489.512805:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2394:x1876092385342848:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181489.512811:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 363 00000100:00080000:3.0:1789181489.512834:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181489.512839:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181489.512843:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181489.512846:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181489.513082:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385342592 00000100:00100000:1.0:1789181489.513087:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385342592 00000100:00100000:1.0:1789181489.513127:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 396 00000100:00100000:1.0:1789181489.513134:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385342592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181489.513174:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:525f5671-d737-455e-aa6e-3cb90307b925+13:2394:x1876092385342592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181489.513180:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 396 00010000:00010000:2.0:1789181489.758693:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789181490.097807:0:14960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:51:28 (1789181488) 00000100:00100000:0.0:1789181490.445911:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181490.445935:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408459264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181490.446044:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181490.446229:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408459264 00000100:00100000:1.0:1789181490.446238:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408459264 00000100:00100000:1.0:1789181490.446294:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789181490.446304:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408459264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181490.446338:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789181490.446390:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408459264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181490.446397:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789181490.446440:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408459264:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789181490.767157:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181490.957611:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181490.957628:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408459520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181490.957628:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408459392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181490.957850:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181490.957915:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408459392 00000100:00100000:2.0:1789181490.957924:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408459392 00000100:00100000:2.0:1789181490.957976:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789181490.957985:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408459392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181490.958016:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789181490.958060:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408459392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.958068:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1789181490.958096:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181490.958126:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1789181490.958132:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:2.0:1789181490.958157:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408459392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181490.959970:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408459648:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.960015:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408459904:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.960029:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181490.965843:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181490.965920:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408460416:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.965973:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181490.965998:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408460928:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.966019:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181490.966056:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789181490.966063:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408459776:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.966088:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181490.966122:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408460288:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.966144:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181490.966162:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408460800:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.966182:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181490.966230:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408460416 00000100:00100000:1.0:1789181490.966237:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408460416 00000100:00100000:1.0:1789181490.966280:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408460928 00000100:00100000:1.0:1789181490.966283:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408460928 00000100:00100000:1.0:1789181490.966318:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789181490.966328:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408460416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.966376:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408460416:12345-0@lo:400:kworker.0 Request processed in 51us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181490.966383:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789181490.966398:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789181490.966404:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408460928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.966443:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408460928:12345-0@lo:400:kworker.0 Request processed in 39us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181490.966448:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789181490.966468:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408459904 00000100:00100000:1.0:1789181490.966471:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408459904 00000100:00100000:2.0:1789181490.966651:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408460160:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.966682:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181490.966701:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408460672:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.966721:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181490.966749:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789181490.966755:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408460032:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.966775:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181490.966792:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408460544:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.966807:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181490.966830:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408459648 00000100:00100000:2.0:1789181490.966834:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408459648 00000100:00100000:2.0:1789181490.966864:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789181490.966871:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408459648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.966908:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da575344-f445-48a7-8532-0e6efd2ea878+24:3646:x1876092408459648:12345-0@lo:400:kworker.0 Request processed in 38us (6878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.966914:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789181490.966941:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408460032 00000100:00100000:2.0:1789181490.966945:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408460032 00000100:00100000:2.0:1789181490.966969:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789181490.966975:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408460032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.967015:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408460032:12345-0@lo:400:kworker.0 Request processed in 40us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.967021:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789181490.967061:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408460032:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.967072:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da575344-f445-48a7-8532-0e6efd2ea878:3646:1876092408459648:0@lo:400:kworker.0 00000100:00100000:0.0:1789181490.968418:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408459776 00000100:00100000:0.0:1789181490.968443:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408459776 00000100:00100000:1.0:1789181490.969709:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408460288 00000100:00100000:1.0:1789181490.969718:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408460288 00000100:00100000:1.0:1789181490.969752:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408460800 00000100:00100000:1.0:1789181490.969755:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408460800 00000100:00100000:1.0:1789181490.969769:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408460160 00000100:00100000:1.0:1789181490.969784:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408460160 00000100:00100000:3.0:1789181490.972394:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181490.973323:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408460544 00000100:00100000:0.0:1789181490.973335:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408460544 00000100:00100000:0.0:1789181490.973439:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789181490.973451:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408460544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181490.973560:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408460544:12345-0@lo:400:kworker.0 Request processed in 113us (6751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181490.973568:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789181490.973647:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408459520 00000100:00100000:2.0:1789181490.973652:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408459520 00000100:00100000:2.0:1789181490.973681:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789181490.973688:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408459520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789181490.973703:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789181490.973764:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408459520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.973771:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789181490.973811:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408460544:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.973843:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408459520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181490.973886:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408460672 00000100:00100000:2.0:1789181490.973889:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408460672 00000100:00100000:2.0:1789181490.973903:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789181490.973909:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408459904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.973941:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408459904:12345-0@lo:400:kworker.0 Request processed in 32us (8105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.973946:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789181490.973956:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789181490.973962:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408460288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.974001:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408460288:12345-0@lo:400:kworker.0 Request processed in 39us (7856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.974006:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789181490.974016:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789181490.974022:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408460800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.974046:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876092408460800:12345-0@lo:400:kworker.0 Request processed in 24us (7864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.974051:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789181490.974062:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789181490.974068:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408459776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.974094:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408459776:12345-0@lo:400:kworker.0 Request processed in 27us (8005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.974100:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789181490.974110:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789181490.974115:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408460672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.974144:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408460672:12345-0@lo:400:kworker.0 Request processed in 29us (7422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.974150:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789181490.974172:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408460672:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.974504:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789181490.974522:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408460160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.974567:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408460160:12345-0@lo:400:kworker.0 Request processed in 56us (7885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181490.974573:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789181490.974604:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408459776:0@lo:400:kworker.0 00010000:00080000:1.0:1789181490.974619:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093f100 x1876092408460288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181490.974643:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408460288:0@lo:400:kworker.0 00010000:00080000:1.0:1789181490.974656:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dff853800 x1876092408460800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181490.974665:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408460800:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.974675:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408459904:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.974685:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408460416:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.974695:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408460928:0@lo:400:kworker.0 00000100:00100000:0.0:1789181490.981951:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408460160:0@lo:400:kworker.0 00000100:00080000:2.0:1789181490.983080:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181490.983088:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181490.983091:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789181491.788030:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789181491.998987:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1789181491.999006:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789181492.000793:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789181492.000812:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1789181492.623392:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181492.623653:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385343488 00000100:00100000:1.0:1789181492.623666:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385343488 00000100:00100000:1.0:1789181492.623791:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00100000:1.0:1789181492.623803:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:13167:x1876092385343488:12345-192.168.202.1@tcp:101:lsof.0 00010000:00010000:1.0:1789181492.623829:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181492.623899:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb55528351806c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8286 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181492.623962:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283518073 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181492.624175:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283518073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181492.624190:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283518073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181492.624236:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789181492.624239:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181492.624280:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283518073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181492.624305:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12400/0x76fb55528351806c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8286 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181492.624323:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283518073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8286 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181492.624333:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dd8258700) 00010000:00010000:1.0:1789181492.624335:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181492.624339:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12600, rc 0) 00000100:00100000:1.0:1789181492.624403:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:13167:x1876092385343488:12345-192.168.202.1@tcp:101:lsof.0 Request processed in 602us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181492.624410:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 256 00000100:00080000:2.0:1789181492.624472:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789181492.815883:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181493.004122:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181493.004151:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408461056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181493.004235:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181493.004421:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408461056 00000100:00100000:2.0:1789181493.004442:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408461056 00000100:00100000:2.0:1789181493.004519:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789181493.004530:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408461056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789181493.004569:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789181493.004637:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408461056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181493.004644:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789181493.004767:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408461056:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789181493.196146:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181493.196157:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181493.196296:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789181493.196303:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789181493.837205:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181493.838876:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789181494.540507:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181494.540531:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408461184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181494.540598:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181494.541092:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181494.541178:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408461312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181494.541400:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408461184 00000100:00100000:0.0:1789181494.541408:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408461184 00000100:00100000:0.0:1789181494.541460:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789181494.541471:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408461184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181494.541520:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181494.541592:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408461184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181494.541599:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789181494.541668:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181494.542383:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408461184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181494.545319:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408461312 00000100:00100000:0.0:1789181494.545337:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408461312 00000100:00100000:0.0:1789181494.545426:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789181494.545439:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408461312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181494.545466:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789181494.545575:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408461312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (3906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181494.545583:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1789181494.545850:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181494.548077:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408461312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181494.630230:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181494.630594:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181494.630630:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181494.630797:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385344000 00000100:00100000:1.0:1789181494.630809:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385344000 00000100:00100000:1.0:1789181494.630891:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00100000:1.0:1789181494.630902:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385344000:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181494.630982:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385344000:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 82us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181494.631001:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 149 00000100:00080000:0.0:1789181494.631425:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181494.634934:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181494.634965:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181494.635440:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385343616 00000100:00100000:0.0:1789181494.635455:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385343616 00000100:00100000:0.0:1789181494.635552:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 398 00000100:00100000:0.0:1789181494.635564:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385343616:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1789181494.635643:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:525f5671-d737-455e-aa6e-3cb90307b925+13:2393:x1876092385343616:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181494.635650:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 398 00000100:00100000:2.0:1789181494.644050:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385343744 00000100:00100000:2.0:1789181494.644069:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385343744 00000100:00100000:2.0:1789181494.645041:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385344256 00000100:00100000:2.0:1789181494.645050:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385344256 00000100:00100000:2.0:1789181494.645099:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 370 00000100:00100000:2.0:1789181494.645120:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:2393:x1876092385343744:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181494.645213:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:2393:x1876092385343744:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 96us (14995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181494.645221:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 370 00000100:00100000:2.0:1789181494.645251:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 371 00000100:00100000:2.0:1789181494.645259:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2393:x1876092385344256:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181494.645286:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2393:x1876092385344256:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (14656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181494.645651:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 371 00000100:00080000:2.0:1789181494.645674:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181494.646520:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385343872 00000100:00100000:0.0:1789181494.646531:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385343872 00000100:00100000:0.0:1789181494.646594:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 372 00000100:00100000:0.0:1789181494.646606:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385343872:12345-192.168.202.1@tcp:400:kworker.0 00000100:00080000:2.0:1789181494.646678:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181494.650321:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2393:x1876092385343872:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 3706us (15342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181494.650337:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 372 00000100:00100000:3.0:1789181494.650835:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181494.650924:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181494.651023:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385344128 00000100:00100000:1.0:1789181494.651037:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385344128 00000100:00100000:1.0:1789181494.651122:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00100000:1.0:1789181494.651132:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385344128:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181494.651192:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2393:x1876092385344128:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 62us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181494.651198:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 150 00000100:00080000:0.0:1789181494.651855:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181494.657203:0:9021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385344384 00000100:00100000:2.0:1789181494.657251:0:9021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385344384 00000100:00100000:2.0:1789181494.657520:0:9021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 373 00000100:00100000:2.0:1789181494.657537:0:9021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385344384:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181494.657641:0:9021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2393:x1876092385344384:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 109us (6715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181494.657650:0:9021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 373 00000100:00080000:0.0:1789181494.657765:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789181494.688447:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181494.694400:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385344640 00000100:00100000:0.0:1789181494.694419:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385344640 00000100:00100000:0.0:1789181494.694514:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:0.0:1789181494.694526:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+18:13169:x1876092385344640:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:0.0:1789181494.694843:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:13169:x1876092385344640:12345-192.168.202.1@tcp:35:umount.0 Request processed in 318us (6406us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789181494.694853:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:1.0:1789181494.698218:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181494.698451:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385344896 00000100:00100000:0.0:1789181494.698592:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385344896 00000100:00100000:0.0:1789181494.698830:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:0.0:1789181494.698843:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+19:13169:x1876092385344896:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:0.0:1789181494.699129:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:13169:x1876092385344896:12345-192.168.202.1@tcp:35:umount.0 Request processed in 289us (922us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789181494.699137:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:3.0:1789181494.702161:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181494.703097:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385345152 00000100:00100000:2.0:1789181494.703113:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385345152 00000100:00100000:2.0:1789181494.703174:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:2.0:1789181494.703185:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd13d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+20:13169:x1876092385345152:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:2.0:1789181494.703778:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd13d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:13169:x1876092385345152:12345-192.168.202.1@tcp:35:umount.0 Request processed in 594us (1630us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789181494.703788:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:1.0:1789181494.706849:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181494.706942:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385345408 00000100:00100000:2.0:1789181494.706953:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385345408 00000100:00100000:2.0:1789181494.707009:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:2.0:1789181494.707022:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:13169:x1876092385345408:12345-192.168.202.1@tcp:35:umount.0 00000100:00100000:2.0:1789181494.709532:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:13169:x1876092385345408:12345-192.168.202.1@tcp:35:umount.0 Request processed in 2486us (2671us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789181494.709549:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000100:00100000:1.0:1789181494.715339:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181494.715395:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181494.715428:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181494.715899:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181494.715931:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385346176 00000100:00100000:1.0:1789181494.715943:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385346176 00000100:00100000:1.0:1789181494.715996:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 81 00000100:00100000:1.0:1789181494.716006:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+7:2392:x1876092385346176:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:1.0:1789181494.716038:0:8437:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb5552835175ec 00000020:00010000:1.0:1789181494.716047:0:8437:0:(genops.c:1922:obd_stale_export_put()) Put export ffff9c1dc2f1e800: total 0 00000100:00080000:1.0:1789181494.716052:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9c1dc2f1b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789181494.716101:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1789181494.716274:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2392:x1876092385346176:12345-192.168.202.1@tcp:9:umount.0 Request processed in 269us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181494.716282:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 81 00000020:00010000:1.0:1789181494.716301:0:13192:0:(genops.c:1908:obd_stale_export_get()) Get export ffff9c1dc2f1e800: total 0 00010000:00010000:1.0:1789181494.716323:0:13192:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c1dc2f1e800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789181494.716390:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ae9c5c/0x76fb5552835179a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80a3 expref: 4 pid: 8629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.716428:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa6e3e49/0x76fb555283518065 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df827f expref: 3 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.716442:0:13192:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c1dc2f1e800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789181494.716454:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181494.716456:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181494.716457:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181494.718529:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385345536 00000100:00100000:0.0:1789181494.718547:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385345536 00000100:00100000:1.0:1789181494.718826:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385345792 00000100:00100000:1.0:1789181494.718831:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385345792 00000100:00100000:1.0:1789181494.718866:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385345664 00000100:00100000:1.0:1789181494.718869:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385345664 00000100:00100000:1.0:1789181494.718889:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1789181494.718900:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+15:2396:x1876092385345536:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181494.718918:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181494.718941:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658a200/0x76fb555283516fda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7de0 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.718961:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181494.719032:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+14:2396:x1876092385345536:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 134us (3704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181494.719040:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1789181494.719058:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1789181494.719065:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+13:2396:x1876092385345792:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181494.719073:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181494.719082:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658b600/0x76fb5552835172ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eb9 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.719092:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181494.719109:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+12:2396:x1876092385345792:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 46us (3715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181494.719116:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:1.0:1789181494.719129:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1789181494.719136:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+11:2396:x1876092385345664:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181494.719143:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181494.719152:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523600/0x76fb555283516f9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7da1 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.719168:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181494.719187:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+10:2396:x1876092385345664:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 52us (3759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181494.719194:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1789181494.728265:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181494.728497:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385346304 00000100:00100000:2.0:1789181494.728521:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385346304 00000100:00100000:2.0:1789181494.728594:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 82 00000100:00100000:2.0:1789181494.728833:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2392:x1876092385346304:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:2.0:1789181494.728876:0:8629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283517376 00000100:00080000:2.0:1789181494.728907:0:8629:0:(import.c:65:import_set_state_nolock()) ffff9c1dc78ee000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789181494.728953:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789181494.729132:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c4ab02e-ed68-4ee0-b458-d9073baffb59+2:2392:x1876092385346304:12345-192.168.202.1@tcp:9:umount.0 Request processed in 303us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181494.729140:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 82 00010000:00010000:0.0:1789181494.729460:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181494.739714:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181494.739944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385347328 00000100:00100000:0.0:1789181494.739958:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385347328 00000100:00100000:0.0:1789181494.740024:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 257 00000100:00100000:0.0:1789181494.740034:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+22:2392:x1876092385347328:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:0.0:1789181494.740070:0:6521:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516fa9 00000020:00010000:0.0:1789181494.740086:0:6521:0:(genops.c:1922:obd_stale_export_put()) Put export ffff9c1dfaf26800: total 0 00000100:00080000:0.0:1789181494.740091:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf23000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789181494.740124:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1789181494.740459:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c4ab02e-ed68-4ee0-b458-d9073baffb59+21:2392:x1876092385347328:12345-192.168.202.1@tcp:39:umount.0 Request processed in 425us (755us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789181494.740475:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 257 00000020:00010000:2.0:1789181494.740995:0:6509:0:(genops.c:1908:obd_stale_export_get()) Get export ffff9c1dfaf26800: total 0 00010000:00010000:2.0:1789181494.741046:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c1dfaf26800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789181494.741122:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:2.0:1789181494.741125:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181494.741134:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1cc39f0400/0x76fb555283517d08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8198 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741152:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181494.741154:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181494.741158:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b200/0x76fb555283517885 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8056 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741169:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dd8258700) 00010000:00010000:2.0:1789181494.741173:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181494.741176:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb5552835179ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80b8 expref: 18 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741188:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181494.741190:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181494.741193:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f400/0x76fb555283517f46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8232 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741205:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1dc6843a00) 00010000:00010000:2.0:1789181494.741216:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181494.741221:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679200/0x76fb5552835172d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ec7 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741240:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c1dfadc6d00) 00010000:00010000:2.0:1789181494.741242:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789181494.741246:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085fa00/0x76fb555283517a1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df80bf expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741270:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:2.0:1789181494.741272:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789181494.741276:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351734c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ee3 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741287:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181494.741289:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181494.741293:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085f000/0x76fb555283517965 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df808e expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741304:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c1dc6843100) 00010000:00010000:2.0:1789181494.741306:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181494.741309:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0085ec00/0x76fb555283517647 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7fbc expref: 12 pid: 9021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741321:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181494.741322:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181494.741325:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518026 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df826a expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741348:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dcf5c0500) 00010000:00010000:2.0:1789181494.741350:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181494.741354:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12e00/0x76fb5552835172f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7ece expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741367:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c1dd82e2600) 00010000:00010000:2.0:1789181494.741369:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789181494.741372:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a800/0x76fb555283518050 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8278 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741395:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c1dd8258500) 00010000:00010000:2.0:1789181494.741398:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789181494.741401:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a600/0x76fb55528351798f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df809c expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.741413:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c1dfaf26800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789181494.741426:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181494.741428:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181494.741430:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181494.755191:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181494.755818:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385347456 00000100:00100000:0.0:1789181494.755831:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385347456 00000100:00100000:0.0:1789181494.755897:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 258 00000100:00100000:0.0:1789181494.755907:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+5:2392:x1876092385347456:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:0.0:1789181494.755943:0:6522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516fb0 00000100:00080000:0.0:1789181494.755972:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9c1cc3924800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789181494.756003:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789181494.756172:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c4ab02e-ed68-4ee0-b458-d9073baffb59+3:2392:x1876092385347456:12345-192.168.202.1@tcp:39:umount.0 Request processed in 266us (993us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789181494.756180:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 258 00010000:00010000:1.0:1789181494.757277:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181494.860570:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181495.564748:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408461440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181495.564842:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181495.567587:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408461440 00000100:00100000:0.0:1789181495.567605:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408461440 00000100:00100000:0.0:1789181495.567678:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789181495.567689:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408461440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181495.567849:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789181495.568045:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408461440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 357us (3203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181495.568053:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789181495.574661:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408461440:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789181495.884814:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181496.076103:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408461568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181496.076187:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181496.076321:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408461568 00000100:00100000:2.0:1789181496.076330:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408461568 00000100:00100000:2.0:1789181496.076390:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789181496.076401:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408461568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789181496.076434:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789181496.076514:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408461568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181496.076539:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1789181496.076610:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181496.076650:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408461568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181496.076994:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181496.077004:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408461696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181496.077036:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181496.077166:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408461696 00000100:00100000:0.0:1789181496.077170:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408461696 00000100:00100000:0.0:1789181496.077221:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789181496.077229:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408461696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181496.077243:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789181496.077281:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408461696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181496.077287:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789181496.077319:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408461696:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789181496.078068:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181496.078283:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408462208:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.078329:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181496.078362:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408462720:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.078384:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181496.078406:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789181496.078411:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408462080:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.078433:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181496.078446:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408462592:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.078463:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181496.078493:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408463104:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.078513:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181496.078544:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408462720 00000100:00100000:3.0:1789181496.078545:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408462208 00000100:00100000:1.0:1789181496.078550:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408462720 00000100:00100000:3.0:1789181496.078553:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408462208 00000100:00100000:1.0:1789181496.078590:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789181496.078599:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408462720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.078643:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408462720:12345-0@lo:400:kworker.0 Request processed in 44us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181496.078659:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408462592 00000100:00100000:3.0:1789181496.078665:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408462592 00000100:00100000:1.0:1789181496.078666:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789181496.078694:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408463104 00000100:00100000:3.0:1789181496.078698:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408463104 00000100:00100000:1.0:1789181496.078700:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789181496.078710:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408462208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.078764:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876092408462208:12345-0@lo:400:kworker.0 Request processed in 56us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181496.078813:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789181496.078816:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408461824:0@lo:400:kworker.0 00000100:00100000:3.0:1789181496.078827:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408462592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181496.078854:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181496.078883:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408462592:12345-0@lo:400:kworker.0 Request processed in 59us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181496.078886:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408462336:0@lo:400:kworker.0 00000100:00100000:0.0:1789181496.078947:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408461824 00000100:00100000:0.0:1789181496.078952:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408461824 00000100:00100000:0.0:1789181496.078993:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789181496.079000:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408461824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181496.079034:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408461824:12345-0@lo:400:kworker.0 Request processed in 34us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181496.079039:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789181496.079067:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408462080 00000100:00100000:0.0:1789181496.079071:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408462080 00000100:00100000:0.0:1789181496.079096:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789181496.079103:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408462080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181496.079134:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408462080:12345-0@lo:400:kworker.0 Request processed in 31us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181496.079140:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789181496.079244:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789181496.079260:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789181496.079267:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408463104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079299:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876092408463104:12345-0@lo:400:kworker.0 Request processed in 33us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181496.079304:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789181496.079339:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408462080:0@lo:400:kworker.0 00010000:00080000:1.0:1789181496.079352:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc437b100 x1876092408462592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181496.079362:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408462592:0@lo:400:kworker.0 00010000:00080000:1.0:1789181496.079372:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4378e00 x1876092408463104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181496.079380:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408463104:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079389:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876092408462208:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079397:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408462720:0@lo:400:kworker.0 00000100:00080000:1.0:1789181496.079446:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181496.079450:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181496.079495:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408461952:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079521:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181496.079539:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408462464:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079557:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181496.079568:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408462976:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079583:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181496.079603:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408461952 00000100:00100000:1.0:1789181496.079606:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408461952 00000100:00100000:1.0:1789181496.079621:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408462464 00000100:00100000:1.0:1789181496.079623:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408462464 00000100:00100000:1.0:1789181496.079637:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408462976 00000100:00100000:1.0:1789181496.079639:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408462976 00000100:00100000:1.0:1789181496.079650:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789181496.079655:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408461952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079684:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408461952:12345-0@lo:400:kworker.0 Request processed in 29us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181496.079690:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789181496.079701:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789181496.079706:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408462464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079762:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408462464:12345-0@lo:400:kworker.0 Request processed in 56us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181496.079767:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789181496.079777:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789181496.079782:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408462976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079806:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876092408462976:12345-0@lo:400:kworker.0 Request processed in 25us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181496.079819:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00080000:1.0:1789181496.079832:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181496.079849:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408461952:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079857:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408462464:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.079864:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1876092408462976:0@lo:400:kworker.0 00000100:00100000:2.0:1789181496.080406:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181496.080443:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408462848:0@lo:400:kworker.0 00000100:00100000:2.0:1789181496.080493:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181496.080526:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408461824:0@lo:400:kworker.0 00000100:00100000:2.0:1789181496.080554:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408462848 00000100:00100000:2.0:1789181496.080560:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408462848 00000100:00100000:2.0:1789181496.080600:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789181496.080608:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408462848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181496.080645:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408462848:12345-0@lo:400:kworker.0 Request processed in 39us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181496.080651:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1789181496.080667:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181496.080689:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408462848:0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.082116:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408462336 00000100:00100000:1.0:1789181496.082132:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408462336 00000100:00100000:1.0:1789181496.082202:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789181496.082213:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408462336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181496.082291:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408462336:12345-0@lo:400:kworker.0 Request processed in 80us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181496.082298:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789181496.082404:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408462336:0@lo:400:kworker.0 00000100:00100000:3.0:1789181496.084178:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789181496.875037:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181496.875760:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385347584 00000100:00100000:2.0:1789181496.875773:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385347584 00000100:00100000:2.0:1789181496.875877:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1789181496.875889:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+10:2395:x1876092385347584:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181496.875906:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181496.875928:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085e400/0x76fb5552835170ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7df5 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.875948:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181496.876016:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+9:2395:x1876092385347584:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 130us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181496.876023:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1789181496.876148:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181496.876194:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385347840 00000100:00100000:2.0:1789181496.876198:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385347840 00000100:00100000:2.0:1789181496.876232:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1789181496.876239:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:525f5671-d737-455e-aa6e-3cb90307b925+9:2396:x1876092385347840:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181496.876247:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181496.876256:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f0c00/0x76fb5552835170b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7e26 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.876264:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181496.876283:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:525f5671-d737-455e-aa6e-3cb90307b925+8:2396:x1876092385347840:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181496.876289:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1789181496.886356:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181496.886611:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181496.886866:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385347712 00000100:00100000:2.0:1789181496.886877:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385347712 00000100:00100000:2.0:1789181496.886955:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1789181496.886966:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc66ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+8:2393:x1876092385347712:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181496.886982:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181496.887017:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658be00/0x76fb5552835172a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7eb2 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.887035:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181496.887098:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc66ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:525f5671-d737-455e-aa6e-3cb90307b925+7:2393:x1876092385347712:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 135us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181496.887105:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1789181496.889678:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385348096 00000100:00100000:3.0:1789181496.889693:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385348096 00000100:00100000:3.0:1789181496.889855:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00100000:3.0:1789181496.889867:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+6:2392:x1876092385348096:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:3.0:1789181496.889908:0:14725:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb5552835170c1 00000020:00010000:3.0:1789181496.889916:0:14725:0:(genops.c:1922:obd_stale_export_put()) Put export ffff9c1cc38d7800: total 0 00000100:00080000:3.0:1789181496.889920:0:14725:0:(import.c:65:import_set_state_nolock()) ffff9c1cc38d2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789181496.889956:0:14725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1789181496.890131:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2392:x1876092385348096:12345-192.168.202.1@tcp:39:umount.0 Request processed in 266us (3519us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789181496.890152:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 259 00000100:00080000:2.0:1789181496.890230:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1789181496.890569:0:13192:0:(genops.c:1908:obd_stale_export_get()) Get export ffff9c1cc38d7800: total 0 00010000:00010000:0.0:1789181496.890573:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181496.890639:0:13192:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c1cc38d7800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789181496.890682:0:13192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dd8258700) 00010000:00010000:0.0:1789181496.890685:0:13192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181496.890691:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb555283518073 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8286 expref: 4 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.890708:0:13192:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c1cc38d7800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789181496.890718:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181496.890719:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181496.890720:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181496.901528:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181496.901770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385348224 00000100:00100000:2.0:1789181496.901781:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385348224 00000100:00100000:2.0:1789181496.901861:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 260 00000100:00100000:2.0:1789181496.901870:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+5:2392:x1876092385348224:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:2.0:1789181496.901919:0:6522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb5552835170c8 00000100:00080000:2.0:1789181496.901928:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9c1cc38d2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789181496.901956:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789181496.902108:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0e89ea0-dcb5-49cb-8994-643fecfb5dac+3:2392:x1876092385348224:12345-192.168.202.1@tcp:39:umount.0 Request processed in 239us (594us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789181496.902117:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 260 00010000:00010000:0.0:1789181496.902599:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181496.902757:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789181496.908021:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181496.947209:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181496.947557:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385348480 00000100:00100000:0.0:1789181496.947569:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385348480 00000100:00100000:0.0:1789181496.947635:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 400 00000100:00100000:0.0:1789181496.947646:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+7:2392:x1876092385348480:12345-192.168.202.1@tcp:251:umount.0 00000020:00000080:0.0:1789181496.947697:0:6516:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516f86 00000020:00010000:0.0:1789181496.947706:0:6516:0:(genops.c:1922:obd_stale_export_put()) Put export ffff9c1cc3921000: total 0 00000100:00080000:0.0:1789181496.947711:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9c1cc3925800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1789181496.947812:0:13192:0:(genops.c:1908:obd_stale_export_get()) Get export ffff9c1cc3921000: total 0 00000100:00100000:0.0:1789181496.947831:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de60b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:525f5671-d737-455e-aa6e-3cb90307b925+3:2392:x1876092385348480:12345-192.168.202.1@tcp:251:umount.0 Request processed in 185us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181496.947840:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 400 00010000:00010000:1.0:1789181496.947875:0:13192:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c1cc3921000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789181496.949596:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f1000/0x76fb555283516fe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df7de7 expref: 2 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.949629:0:13192:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c1cc3921000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789181496.949672:0:13192:0:(genops.c:885:class_export_put()) final put ffff9c1cc3921000/525f5671-d737-455e-aa6e-3cb90307b925 00010000:00010000:1.0:1789181496.949710:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181496.949713:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181496.949715:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789181496.949743:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc3921000/525f5671-d737-455e-aa6e-3cb90307b925 for MGS 00000020:00000080:1.0:1789181496.949782:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc3925800 for MGS 00010000:00010000:2.0:1789181497.932843:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181498.130542:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408463232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181498.130627:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181498.130798:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408463232 00000100:00100000:2.0:1789181498.130807:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408463232 00000100:00100000:2.0:1789181498.130860:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789181498.130870:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408463232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789181498.130910:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789181498.130967:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408463232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181498.130974:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789181498.131083:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408463232:0@lo:41:osp-pre-1-0.0 00000020:01000004:1.0:1789181498.778331:0:15156:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789181498.787297:0:15156:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789181498.787357:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.787372:0:15156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.787379:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.787385:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.787421:0:15156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789181498.787427:0:15156:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789181498.787466:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789181498.787471:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789181498.787477:0:15156:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789181498.787503:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9c1de7d96800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789181498.788523:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181498.788532:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.788541:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a600 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:0.0:1789181498.788558:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.788569:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181498.788576:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181498.788583:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789181498.788585:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789181498.788588:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789181498.788622:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.788630:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181498.788663:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.788671:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a600/0x76fb55528351703c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517043 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.788682:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181498.788683:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181498.788685:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181498.788694:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181498.788712:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408463488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181498.788799:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181498.806509:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876092408463360:0@lo:39:umount.0 00000100:00100000:0.0:1789181498.806578:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181498.806686:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408463360 00000100:00100000:1.0:1789181498.806695:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408463360 00000100:00100000:1.0:1789181498.806767:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789181498.806776:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876092408463360:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789181498.807524:0:6521:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516b9d 00000100:00080000:1.0:1789181498.807544:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9c1dd36be000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789181498.807631:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1876092408463360:12345-0@lo:39:umount.0 Request processed in 855us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.807640:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:1.0:1789181498.807650:0:6521:0:(genops.c:885:class_export_put()) final put ffff9c1dd36bb800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789181498.807676:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dd36bb800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789181498.807715:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1dd36be000 for lustre-MDT0000 00000100:00080000:3.0:1789181498.807929:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7d96800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789181498.807945:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876092408463360:0@lo:39:umount.0 00010000:00010000:0.0:1789181498.808002:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181498.808083:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789181498.808086:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789181498.808092:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789181498.810624:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408463488 00000100:00100000:2.0:1789181498.810639:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408463488 00000100:00100000:2.0:1789181498.810741:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181498.810753:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+24:3644:x1876092408463488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181498.810770:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181498.810792:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1522200/0x76fb555283517043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb55528351703c expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.810807:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181498.811167:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811181:0:15156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811188:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811195:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811216:0:15156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181498.811223:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811230:0:15156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811236:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811257:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811278:0:15156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789181498.811285:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811293:0:15156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811299:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811306:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811319:0:15156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789181498.811324:0:15156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811331:0:15156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811337:0:15156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811344:0:15156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.811362:0:15156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1789181498.811366:0:15156:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789181498.811394:0:15156:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789181498.811398:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789181498.811403:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181498.811409:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1789181498.811415:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c1cc3268800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789181498.811421:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c1de7e62000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789181498.811426:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c1dfaf41800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789181498.811430:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c1de7ec6800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1789181498.811448:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9c1cc38d7800 d0e89ea0-dcb5-49cb-8994-643fecfb5dac 192.168.202.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789181498.811454:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9c1dfaf26800 3c4ab02e-ed68-4ee0-b458-d9073baffb59 192.168.202.1@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1789181498.811459:0:15156:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9c1dc4390000) has exports, disconnecting them 00000020:00080000:1.0:1789181498.811464:0:15156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c1cc3268800), last request at 1789181496 00000020:00000080:1.0:1789181498.811471:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516ead 00000100:00080000:1.0:1789181498.811491:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9c1cc326d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789181498.811537:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1cc3268800): rc 0 00000020:00000080:1.0:1789181498.811540:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1cc3268800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789181498.811549:0:15156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c1de7e62000), last request at 1789181496 00000020:00000080:1.0:1789181498.811552:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516d87 00000100:00080000:1.0:1789181498.811556:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9c1de7e67800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789181498.811566:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc3268800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789181498.811600:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc326d800 for lustre-MDT0000 00000020:00080000:1.0:1789181498.811611:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1de7e62000): rc 0 00000020:00000080:1.0:1789181498.811619:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1de7e62000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1789181498.811624:0:15156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c1dfaf41800), last request at 1789181254 00000020:00000080:1.0:1789181498.811628:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516c84 00000100:00080000:1.0:1789181498.811632:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf43800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789181498.811641:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7e62000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789181498.811665:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1de7e67800 for lustre-MDT0000 00000020:00080000:1.0:1789181498.811675:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1dfaf41800): rc 0 00000020:00000080:1.0:1789181498.811676:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf41800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1789181498.811682:0:15156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c1de7ec6800), last request at 1789181254 00000020:00000080:1.0:1789181498.811685:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516c45 00000100:00080000:1.0:1789181498.811689:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9c1df9d31800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789181498.811695:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf41800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789181498.811711:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1dfaf43800 for lustre-MDT0000 00000001:00000004:1.0:1789181498.811739:0:15156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1789181498.811822:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1de7ec6800): rc 0 00000004:00000080:1.0:1789181498.812051:0:15156:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa94547a7bae0 00000100:00080000:1.0:1789181498.812075:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789181498.812079:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1789181498.813623:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da575344-f445-48a7-8532-0e6efd2ea878+23:3644:x1876092408463488:12345-0@lo:103:ldlm_bl.0 Request processed in 2862us (24813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181498.813641:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1789181498.813687:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789181498.813696:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.813708:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0e00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181498.813712:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.813740:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181498.813748:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181498.813754:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789181498.813757:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1789181498.813760:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1789181498.813802:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.813949:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181498.813975:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.813982:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0e00/0x76fb55528351704a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517051 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.813999:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789181498.814002:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814008:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e00866e00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181498.814010:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814017:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181498.814023:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181498.814028:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789181498.814030:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789181498.814032:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789181498.814046:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814053:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181498.814071:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814088:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e00866e00/0x76fb555283516f40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516f47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814098:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181498.814102:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814107:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13600 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181498.814111:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814118:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181498.814125:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181498.814130:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789181498.814132:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789181498.814133:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789181498.814147:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814152:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181498.814158:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814163:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13600/0x76fb555283517296 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb55528351729d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814181:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181498.814185:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814190:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522600 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181498.814193:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814199:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181498.814204:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181498.814209:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789181498.814211:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789181498.814213:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789181498.814226:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814230:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181498.814236:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814241:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522600/0x76fb555283516afc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516b03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.814249:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181498.814250:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181498.814259:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181498.814280:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408464000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181498.814331:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181498.814375:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181498.814381:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408463616:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789181498.814709:0:15156:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789181498.814741:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9c1de4308000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789181498.815075:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408463488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181498.815107:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408464128:0@lo:39:umount.0 00000100:00100000:3.0:1789181498.815147:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181498.815212:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181498.815455:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408463744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181498.815483:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181498.815674:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181498.815680:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789181498.816153:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789181498.816157:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1789181498.816170:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789181498.816254:0:15156:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789181498.816271:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9c1dff8a6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789181498.816284:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789181498.816287:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:0.0:1789181498.816294:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789181498.816353:0:15156:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789181498.816360:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dc8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789181498.816389:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c1dc4390000) has no exports 00000001:00100000:1.0:1789181498.817329:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789181498.817335:0:6499:0:(genops.c:885:class_export_put()) final put ffff9c1de7ec6800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789181498.817348:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000001:00080000:1.0:1789181498.817358:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789181498.817361:0:6499:0:(genops.c:885:class_export_put()) final put ffff9c1cc38d7800/d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000001:00100000:1.0:1789181498.817366:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000001:00080000:1.0:1789181498.817372:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789181498.817392:0:6499:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf26800/3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:1.0:1789181498.817481:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7ec6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789181498.817526:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc38d7800/d0e89ea0-dcb5-49cb-8994-643fecfb5dac for lustre-MDT0000 00000020:00000080:1.0:1789181498.817548:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf26800/3c4ab02e-ed68-4ee0-b458-d9073baffb59 for lustre-MDT0000 00000020:00000080:1.0:1789181498.817576:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1df9d31800 for lustre-MDT0000 00000020:00000080:1.0:1789181498.817581:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc38d2000 for lustre-MDT0000 00000020:00000080:1.0:1789181498.817584:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1dfaf23000 for lustre-MDT0000 00000100:00100000:2.0:1789181498.818122:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181498.818132:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408463872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181498.818173:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181498.818193:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408464000 00000100:00100000:3.0:1789181498.818207:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408464000 00000100:00100000:1.0:1789181498.818323:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408463616 00000100:00100000:1.0:1789181498.818328:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408463616 00000100:00100000:1.0:1789181498.818355:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408463744 00000100:00100000:1.0:1789181498.818359:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408463744 00000100:00100000:1.0:1789181498.818376:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789181498.818385:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da575344-f445-48a7-8532-0e6efd2ea878+25:3643:x1876092408464000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181498.818400:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181498.818431:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1679400/0x76fb555283516b03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283516afc expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.818454:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181498.818497:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da575344-f445-48a7-8532-0e6efd2ea878+24:3643:x1876092408464000:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (4167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.818505:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789181498.818521:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789181498.818527:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da575344-f445-48a7-8532-0e6efd2ea878+23:3643:x1876092408463616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181498.818534:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181498.818542:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658b400/0x76fb555283517051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb55528351704a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.818551:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181498.818584:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da575344-f445-48a7-8532-0e6efd2ea878+22:3643:x1876092408463616:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.818590:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789181498.818603:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789181498.818608:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da575344-f445-48a7-8532-0e6efd2ea878+21:3645:x1876092408463744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181498.818615:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181498.818623:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1522c00/0x76fb555283516f47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283516f40 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.818631:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181498.818651:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da575344-f445-48a7-8532-0e6efd2ea878+20:3645:x1876092408463744:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.818656:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789181498.818943:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408463744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181498.818977:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408463872 00000100:00100000:2.0:1789181498.818981:0:7462:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408463872 00000100:00100000:2.0:1789181498.819008:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789181498.819014:0:7462:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+20:3645:x1876092408463872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181498.819022:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181498.819031:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658aa00/0x76fb55528351729d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283517296 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.819041:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181498.819069:0:7462:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da575344-f445-48a7-8532-0e6efd2ea878+19:3645:x1876092408463872:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181498.819074:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789181498.819097:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408464128 00000100:00100000:2.0:1789181498.819102:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408464128 00000100:00100000:2.0:1789181498.819127:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789181498.819142:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876092408464128:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789181498.819171:0:7854:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516cdf 00000100:00080000:2.0:1789181498.819181:0:7854:0:(import.c:65:import_set_state_nolock()) ffff9c1dfb0ff000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789181498.819333:0:7854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789181498.819568:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3642:x1876092408464128:12345-0@lo:39:umount.0 Request processed in 426us (4420us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789181498.819576:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789181498.819605:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408463872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181498.819628:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181498.819646:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408463616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181498.819654:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da575344-f445-48a7-8532-0e6efd2ea878:3643:1876092408464000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181498.819783:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408464256:0@lo:9:umount.0 00000100:00100000:3.0:1789181498.819953:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181498.819983:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408464384:0@lo:9:umount.0 00000100:00100000:3.0:1789181498.820005:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789181498.820030:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de4308000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789181498.820038:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408464128:0@lo:39:umount.0 00000100:00100000:3.0:1789181498.820060:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408464256 00000100:00100000:3.0:1789181498.820064:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408464256 00000100:00100000:3.0:1789181498.820099:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408464384 00000100:00100000:3.0:1789181498.820102:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408464384 00000100:00100000:3.0:1789181498.820120:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789181498.820127:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876092408464256:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789181498.820146:0:8437:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516e2f 00000100:00080000:3.0:1789181498.820153:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f48000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789181498.820198:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789181498.820370:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3642:x1876092408464256:12345-0@lo:9:umount.0 Request processed in 242us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181498.820387:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789181498.820402:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789181498.820585:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876092408464384:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789181498.820598:0:8437:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516f71 00000100:00080000:3.0:1789181498.820604:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f4b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789181498.820703:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:3.0:1789181498.820785:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3642:x1876092408464384:12345-0@lo:9:umount.0 Request processed in 203us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181498.820789:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1789181498.820804:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181498.820807:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789181498.821134:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181498.821157:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789181498.821179:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1dff8a6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789181498.821270:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789181498.821344:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789181498.821349:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408464256:0@lo:9:umount.0 00000100:00080000:3.0:1789181498.821366:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dc8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789181498.821481:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789181498.821570:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789181498.821576:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408464384:0@lo:9:umount.0 00000020:00080000:1.0:1789181498.827787:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c1dc4390000) has no exports 00000020:00000080:1.0:1789181498.877596:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516b57 00000020:00000080:1.0:1789181498.877614:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1de7cc1000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789181498.877624:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789181498.877692:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7cc1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789181498.877692:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181498.877706:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789181498.877711:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9c1dc4e04d40) has no exports 00000020:00000080:0.0:1789181498.880290:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516b50 00000020:00000080:0.0:1789181498.880303:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1de7c66000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789181498.880327:0:12254:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7c66000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789181498.880383:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181498.880396:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789181498.880399:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1de7c66800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789181498.880401:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7c66800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789181498.880405:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1789181498.880590:0:15156:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c1cc1fafa20 - data ffff9c1de4b71000/ffff9c1cc31c6c00 00000020:01000000:0.0:1789181498.880768:0:15156:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c1dd17e3ae0 - data ffff9c1de494fca8/ffff9c1df1a19c00 00000001:00000004:2.0:1789181498.910778:0:15156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1789181498.951515:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789181498.951524:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789181498.951541:0:15156:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c1dc4379f80 x1876092408464128/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789181508 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181498.951568:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789181498.954488:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789181498.954495:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1789181498.954514:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789181498.954516:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789181498.954967:0:8624:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789181498.954972:0:8624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789181498.955015:0:8624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00010000:00010000:1.0:1789181498.956059:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789181498.958283:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789181498.958293:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:2.0:1789181498.958308:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789181498.958311:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789181498.960172:0:9989:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789181498.960184:0:9989:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789181498.960214:0:9989:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789181498.963475:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516b1f 00000020:00000080:2.0:1789181498.963488:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc4386000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789181498.963596:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc4386000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789181498.974596:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516b34 00000020:00000080:2.0:1789181498.974612:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc4381000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789181498.974622:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789181498.974630:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc4381000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789181498.974641:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789181498.974651:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789181498.974656:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9c1dc4394d40) has no exports 00000004:01000000:2.0:1789181498.977026:0:15156:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789181498.977043:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516f6a 00000020:00000080:2.0:1789181498.977053:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1e00843000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789181498.977068:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789181498.977088:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1e00843000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789181498.977108:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789181498.977122:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789181498.977126:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff9c1cc38ecd40) has no exports 00000020:00000080:2.0:1789181498.977134:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516f63 00000020:00000080:2.0:1789181498.977137:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1cc1dcc000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789181498.977150:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc1dcc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789181498.979980:0:15156:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789181498.979990:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789181498.979996:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:2.0:1789181498.980005:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789181498.980008:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789181498.980054:0:27:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc1dc8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789181498.980094:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789181498.980111:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789181498.980117:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1e00844000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789181498.980121:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1e00844000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789181498.980128:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789181498.980571:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516e28 00000020:00000080:2.0:1789181498.980591:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dff8a7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789181498.980600:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789181498.980609:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dff8a7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789181498.980618:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789181498.980625:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789181498.980629:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9c1dc4e03380) has no exports 00000020:00000080:2.0:1789181498.980635:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516e21 00000020:00000080:2.0:1789181498.980639:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dff8a5800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789181498.980649:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dff8a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789181498.982081:0:15156:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789181498.982090:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789181498.982095:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1789181498.982103:0:15156:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789181498.982105:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789181498.982139:0:27:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1dff8a6800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789181498.982189:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789181498.983509:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789181498.983519:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dff8a0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789181498.983524:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dff8a0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789181498.983532:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1789181498.983635:0:15156:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789181498.983644:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516cd8 00000020:00000080:2.0:1789181498.983651:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf24000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789181498.983664:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789181498.983679:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf24000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789181498.983691:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789181498.983701:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789181498.983705:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9c1dfaf48000) has no exports 00000020:00000080:2.0:1789181498.983712:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516cd1 00000020:00000080:2.0:1789181498.983715:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1de4309000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789181498.984556:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de4309000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789181498.995848:0:15156:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789181498.995856:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789181498.995860:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789181498.995867:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789181498.995891:0:12254:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1de4308000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789181498.995945:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181498.995956:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789181498.995960:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf20000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789181498.995963:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf20000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789181498.995971:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789181498.996196:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181498.996200:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789181498.996203:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc4386800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789181498.996204:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc4386800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789181498.996209:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789181498.996249:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516b3b 00000020:00000080:0.0:1789181498.996254:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc4380000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789181498.996260:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789181498.996266:0:12254:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc4380000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789181498.996272:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181498.996276:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789181498.996279:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9c1dc4393380) has no exports 00000020:00000080:0.0:1789181498.996297:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181498.996299:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789181498.996302:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc4380800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789181498.996303:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc4380800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789181498.996340:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789181498.996368:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516b42 00000020:00000080:0.0:1789181498.996372:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc4387000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789181498.996381:0:12254:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc4387000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789181498.996390:0:15156:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1dc32aa000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789181498.996392:0:15156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1dc32aa000 3 00000020:01000004:0.0:1789181498.996395:0:15156:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c1dc32aa000 from lustre-MDT0000 00000020:00000080:0.0:1789181498.996410:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181498.996413:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789181498.996415:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc4384000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789181498.996416:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc4384000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789181498.996421:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789181498.996505:0:15156:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789181498.996510:0:15156:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789181498.996512:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789181498.996515:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181498.996518:0:15156:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789181498.996525:0:15156:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9c1dd002b000 da575344-f445-48a7-8532-0e6efd2ea878 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789181498.996530:0:15156:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9c1dd9304d40) has exports, disconnecting them 00000020:00080000:0.0:1789181498.996535:0:15156:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c1dd002b000), last request at 1789181234 00000020:00000080:0.0:1789181498.996551:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516ae0 00000020:00010000:0.0:1789181498.996555:0:15156:0:(genops.c:1922:obd_stale_export_put()) Put export ffff9c1dd002b000: total 0 00000100:00080000:0.0:1789181498.996560:0:15156:0:(import.c:65:import_set_state_nolock()) ffff9c1dd002f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789181498.996625:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1dd002b000): rc 0 00000020:00080000:0.0:1789181498.996629:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9c1dd9304d40) has no exports 00000100:00100000:0.0:1789181498.996695:0:6515:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c1dc713b200:6515] 1 exiting: rc = 0 00000100:00100000:0.0:1789181498.996811:0:6516:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c1dc7398600:6516] 2 exiting: rc = 0 00000020:00010000:1.0:1789181499.001246:0:13192:0:(genops.c:1908:obd_stale_export_get()) Get export ffff9c1dd002b000: total 0 00000100:00100000:2.0:1789181499.001308:0:6513:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c1dc8c01a00:6513] 0 exiting: rc = 1 00010000:00010000:1.0:1789181499.002590:0:13192:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c1dd002b000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789181499.002650:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523800/0x76fb55528351705f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283517058 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002675:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523a00/0x76fb555283516fef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283516fe8 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002686:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e00867a00/0x76fb555283516f01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283516efa expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002720:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085e600/0x76fb555283516ffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283516ff6 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002745:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1522e00/0x76fb555283517019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283517012 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002754:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523200/0x76fb55528351700b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283517004 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002764:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1523c00/0x76fb555283517035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb55528351702e expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002774:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658b800/0x76fb555283516bea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283516be3 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002786:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1de0b12000/0x76fb555283517273 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb55528351726c expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002796:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1de0b13e00/0x76fb555283517281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb55528351727a expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002804:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e021f0600/0x76fb555283517027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283517020 expref: 4 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002814:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1678c00/0x76fb555283516bdc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283516bd5 expref: 3 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002827:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658a400/0x76fb55528351728f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x76fb555283517288 expref: 2 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.002848:0:13192:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c1dd002b000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789181499.002869:0:13192:0:(genops.c:885:class_export_put()) final put ffff9c1dd002b000/da575344-f445-48a7-8532-0e6efd2ea878 00010000:00010000:1.0:1789181499.002886:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181499.002888:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181499.002890:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789181499.002903:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dd002b000/da575344-f445-48a7-8532-0e6efd2ea878 for MGS 00000020:00000080:1.0:1789181499.002937:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1dd002f000 for MGS 00000100:00100000:0.0:1789181499.003048:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003054:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003059:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003064:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003074:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003078:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003082:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003087:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003090:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003095:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003100:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003105:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003118:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003125:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003130:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003136:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003142:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003149:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003154:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003161:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003166:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003170:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003174:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003178:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003182:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003185:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003189:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003193:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003198:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003201:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003206:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003209:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003213:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003217:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003223:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003228:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003234:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003239:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003243:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003255:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003261:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003266:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003271:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003276:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003281:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003286:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003292:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003298:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003304:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003309:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003314:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003319:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003341:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003347:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003352:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003358:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003363:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003368:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003374:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003380:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003387:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003393:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003399:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181499.003404:0:15156:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789181499.004635:0:15156:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c1dc4374840 - data ffff9c1de4b72870/ffff9c1dfb2d0c00 00000020:01000000:1.0:1789181499.004945:0:15156:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c1dd8285d20 - data ffff9c1de48305e8/ffff9c1dd6331000 00000020:00000080:1.0:1789181499.005586:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516ac4 00000020:00000080:1.0:1789181499.005597:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc7393800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789181499.005612:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc7393800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1789181499.005624:0:15156:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1dc32aa000 from MGS, refs=2 00000020:01000004:1.0:1789181499.005627:0:15156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1dc32aa000 2 00000020:01000004:1.0:1789181499.005630:0:15156:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c1dc32aa000 from MGS 00000020:00000080:1.0:1789181499.005650:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789181499.005657:0:15156:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789181499.005660:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc7391800/MGS 00000020:00000080:1.0:1789181499.005662:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc7391800/MGS for MGS 00000020:01000000:1.0:1789181499.005669:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789181499.005825:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789181499.005831:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181499.005837:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789181499.005845:0:15156:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c1de7cc2800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789181499.005851:0:15156:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9c1dc43919c0) has exports, disconnecting them 00000020:00080000:1.0:1789181499.005855:0:15156:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c1de7cc2800), last request at 1789181235 00000020:00000080:1.0:1789181499.005859:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516b8f 00000020:00080000:1.0:1789181499.005869:0:15156:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1de7cc2800): rc 0 00000020:00000080:1.0:1789181499.005873:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1de7cc2800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789181499.005908:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7cc2800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789181499.007792:0:15156:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789181499.007802:0:15156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789181499.007807:0:15156:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789181499.007815:0:15156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789181499.007845:0:12254:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1de7d96800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789181499.008585:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181499.008594:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789181499.008599:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc4383000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789181499.008611:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc4383000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789181499.008616:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789181499.008688:0:15156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1dc32aa000 1 00000020:00000080:0.0:1789181499.008694:0:15156:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516ab6 00000020:00000080:0.0:1789181499.008700:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1dc7394000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789181499.008710:0:15156:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789181499.008719:0:12254:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc7394000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789181499.008746:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181499.008751:0:15156:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789181499.008754:0:15156:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9c1dc4e019c0) has no exports 00000020:00000080:0.0:1789181499.189951:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181499.189965:0:15156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789181499.189972:0:15156:0:(genops.c:885:class_export_put()) final put ffff9c1df3d91800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789181499.189979:0:15156:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df3d91800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789181499.189985:0:15156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789181499.190220:0:15156:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c1dc738b000 00000020:02000400:0.0:1789181499.190357:0:15156:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1789181499.660150:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181499.660182:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408464512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181499.660279:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181499.660665:0:13821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408464512 00000100:00100000:1.0:1789181499.660676:0:13821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408464512 00000100:00100000:1.0:1789181499.660785:0:13821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789181499.660796:0:13821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408464512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789181499.660830:0:13821:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789181499.660896:0:13821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408464512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181499.660903:0:13821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789181499.660963:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408464512:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789181499.663478:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181499.980418:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181500.685370:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408464640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181500.685461:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181500.685652:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408464640 00000100:00100000:1.0:1789181500.685663:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408464640 00000100:00100000:1.0:1789181500.685749:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789181500.685759:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1876092408464640:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1789181500.685769:0:6526:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789181500.685816:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1876092408464640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (354us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789181500.685823:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:02020000:3.0:1789181500.685961:0:3645:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1789181500.693774:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789181500.693782:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9c1df9d2c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789181500.693786:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789181500.707857:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9c1df9d2c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789181500.707886:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 210 00000100:00080000:3.0:1789181500.707902:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c1df9d2c000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1789181500.709765:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc4300a80 x1876092408464768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789181500.710534:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408464768:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789181500.710612:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181500.710813:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408464768 00000100:00100000:2.0:1789181500.710823:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408464768 00000100:00100000:2.0:1789181500.710870:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789181500.710878:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876092408464768:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789181500.710901:0:6527:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789181500.710951:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876092408464768:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 72us (338us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789181500.710958:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1789181500.711037:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1df9d2c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181500.711044:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789181500.711048:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408464768:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1789181501.004481:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181501.202008:0:1011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789181501.202014:0:1011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789181501.202017:0:1011:0:(import.c:65:import_set_state_nolock()) ffff9c1df9d2c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181501.202024:0:1011:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 456 00000100:00080000:1.0:1789181501.202029:0:1011:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789181501.202039:0:1011:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c1df9d2c000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181501.202059:0:1011:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc437a300 x1876092408465024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181501.202311:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408465152:0@lo:400:kworker.0 00000100:00100000:1.0:1789181501.202368:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181501.202414:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408465664:0@lo:400:kworker.0 00000100:00100000:1.0:1789181501.202447:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181501.202476:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789181501.202481:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408465280:0@lo:400:kworker.0 00000100:00100000:1.0:1789181501.202498:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181501.202507:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408465792:0@lo:400:kworker.0 00000100:00100000:1.0:1789181501.202518:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181501.202544:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408465152 00000100:00100000:1.0:1789181501.202551:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408465152 00000100:00100000:1.0:1789181501.202587:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408465664 00000100:00100000:1.0:1789181501.202590:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408465664 00000100:00100000:1.0:1789181501.202598:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408465280 00000100:00100000:1.0:1789181501.202600:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408465280 00000100:00100000:1.0:1789181501.202607:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408465792 00000100:00100000:1.0:1789181501.202609:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408465792 00000100:00100000:1.0:1789181501.202637:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789181501.202648:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408465792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181501.202707:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408465792:12345-0@lo:400:kworker.0 Request processed in 61us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181501.202714:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789181501.202756:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789181501.202760:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876092408465152:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789181501.202766:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789181501.202792:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876092408465152:12345-0@lo:400:kworker.0 Request processed in 31us (423us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789181501.202806:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789181501.203016:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789181501.203021:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876092408465664:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789181501.203027:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789181501.203047:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876092408465664:12345-0@lo:400:kworker.0 Request processed in 26us (600us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789181501.203051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789181501.203060:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789181501.203062:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876092408465280:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789181501.203065:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789181501.203076:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876092408465280:12345-0@lo:400:kworker.0 Request processed in 13us (577us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789181501.203079:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1789181501.203103:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789181501.203107:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c1cc2474800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789181501.203109:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789181501.204061:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408465408:0@lo:400:kworker.0 00000100:00100000:2.0:1789181501.204115:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181501.204150:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408465920:0@lo:400:kworker.0 00000100:00100000:2.0:1789181501.204174:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181501.204209:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789181501.204216:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408464896:0@lo:400:kworker.0 00000400:00000100:2.0:1789181501.204235:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876092408464896 offset 0 length 224: 4 00000100:00100000:2.0:1789181501.204252:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408465536:0@lo:400:kworker.0 00000100:00100000:2.0:1789181501.204272:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181501.204302:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408465920 00000100:00100000:2.0:1789181501.204308:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408465920 00000100:00100000:2.0:1789181501.204374:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408465536 00000100:00100000:2.0:1789181501.204378:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408465536 00000100:00100000:2.0:1789181501.204401:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789181501.204409:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408465920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181501.204470:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408465920:12345-0@lo:400:kworker.0 Request processed in 62us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181501.204477:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789181501.204494:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789181501.204499:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408465536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181501.204523:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408465536:12345-0@lo:400:kworker.0 Request processed in 25us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181501.204529:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789181501.204567:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408465536:0@lo:400:kworker.0 00000100:00100000:2.0:1789181501.204577:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408465920:0@lo:400:kworker.0 00000100:00100000:3.0:1789181501.205470:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408465408 00000100:00100000:3.0:1789181501.205480:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408465408 00000100:00100000:3.0:1789181501.205534:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789181501.205543:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408465408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181501.205614:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408465408:12345-0@lo:400:kworker.0 Request processed in 73us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181501.205620:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00080000:3.0:1789181501.205680:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c1dc4379880 x1876092408465408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181501.205696:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408465408:0@lo:400:kworker.0 00000001:00100000:3.0:1789181501.207050:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789181501.207058:0:8431:0:(genops.c:885:class_export_put()) final put ffff9c1de7f4a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789181501.207074:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:3.0:1789181501.207076:0:8431:0:(genops.c:885:class_export_put()) final put ffff9c1dc78ea000/3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:3.0:1789181501.207090:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7f4a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789181501.207130:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc78ea000/3c4ab02e-ed68-4ee0-b458-d9073baffb59 for lustre-OST0000 00000020:00000080:3.0:1789181501.207147:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1de7f48000 for lustre-OST0000 00000020:00000080:3.0:1789181501.207152:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1dc78ee000 for lustre-OST0000 00000100:00100000:0.0:1789181501.208056:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408465024:0@lo:38:kworker.0 00000100:00100000:0.0:1789181501.208134:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789181501.208940:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789181501.208946:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181501.208950:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181501.209507:0:7854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408465024 00000100:00100000:0.0:1789181501.209517:0:7854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408465024 00000100:00100000:0.0:1789181501.209556:0:7854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789181501.209573:0:7854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1876092408465024:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789181501.209600:0:7854:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789181501.209684:0:7854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1876092408465024:12345-0@lo:38:kworker.0 Request processed in 110us (1550us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789181501.209692:0:7854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789181501.209751:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408466048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181501.209808:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181501.210135:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408466048 00000100:00100000:3.0:1789181501.210140:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408466048 00000100:00100000:3.0:1789181501.210178:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789181501.210264:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408466048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181501.210294:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789181501.210341:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408466048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181501.210357:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789181501.212128:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408466048:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789181501.214041:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1df9d2c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181501.214053:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789181501.214058:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408465024:0@lo:38:kworker.0 00000001:00100000:3.0:1789181501.223984:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789181501.224003:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789181501.224010:0:7452:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf27800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789181501.224025:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000001:00080000:3.0:1789181501.224029:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789181501.224031:0:7452:0:(genops.c:885:class_export_put()) final put ffff9c1cc38d4000/d0e89ea0-dcb5-49cb-8994-643fecfb5dac 00000001:00100000:3.0:1789181501.224037:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000001:00080000:3.0:1789181501.224042:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789181501.224043:0:7452:0:(genops.c:885:class_export_put()) final put ffff9c1cc3925000/3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:3.0:1789181501.224068:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf27800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789181501.224120:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc38d4000/d0e89ea0-dcb5-49cb-8994-643fecfb5dac for lustre-MDT0001 00000020:00000080:3.0:1789181501.224144:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc3925000/3c4ab02e-ed68-4ee0-b458-d9073baffb59 for lustre-MDT0001 00000020:00000080:3.0:1789181501.224168:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1dfb0ff000 for lustre-MDT0001 00000020:00000080:3.0:1789181501.224172:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc38d2800 for lustre-MDT0001 00000020:00000080:3.0:1789181501.224176:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc3924800 for lustre-MDT0001 00000100:00080000:1.0:1789181501.227494:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c1cc2474800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181501.227507:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 231 00000100:00080000:1.0:1789181501.228306:0:3643:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c1cc2474800 using connection 192.168.202.101@tcp/0@lo 00000001:00100000:2.0:1789181501.230753:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789181501.230765:0:9516:0:(genops.c:885:class_export_put()) final put ffff9c1df1a63800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789181501.230787:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:2.0:1789181501.230790:0:9516:0:(genops.c:885:class_export_put()) final put ffff9c1dc2f1e800/3c4ab02e-ed68-4ee0-b458-d9073baffb59 00000020:00000080:2.0:1789181501.230805:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df1a63800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789181501.230848:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dc2f1e800/3c4ab02e-ed68-4ee0-b458-d9073baffb59 for lustre-OST0001 00000020:00000080:2.0:1789181501.230868:0:27:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1de7f4b800 for lustre-OST0001 00000020:00000080:2.0:1789181501.230873:0:27:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1dc2f1b000 for lustre-OST0001 00000100:00100000:1.0:1789181501.231070:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f06300 x1876092408466176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789181501.231139:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876092408466176:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789181501.231233:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181501.231336:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408465280:0@lo:400:kworker.0 00010000:00080000:1.0:1789181501.231366:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c1dff852d80 x1876092408465792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181501.231479:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408466176 00000100:00100000:2.0:1789181501.231488:0:14725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408466176 00000100:00100000:2.0:1789181501.231604:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789181501.231612:0:14725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1876092408466176:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1789181501.231637:0:14725:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789181501.231699:0:14725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1876092408466176:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 86us (466us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789181501.231706:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1789181501.231717:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc2474800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789181501.231755:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789181501.231759:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876092408466176:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789181501.232063:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408465792:0@lo:400:kworker.0 00000100:00080000:1.0:1789181501.232084:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789181501.232088:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c1de430e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789181501.232092:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789181501.232098:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c1de430e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181501.232102:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 210 00000100:00080000:1.0:1789181501.232115:0:3643:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c1de430e800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181501.232137:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f04000 x1876092408466304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181501.232161:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408465152:0@lo:400:kworker.0 00000100:00100000:3.0:1789181501.232458:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876092408466304:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789181501.232500:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181501.232538:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408466304 00000100:00100000:3.0:1789181501.232611:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408466304 00000100:00080000:1.0:1789181501.232639:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1789181501.232641:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1789181501.232643:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c1e00841800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1789181501.232647:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876092408466304:12345-0@lo:38:ptlrpcd_00_00.0 00000100:02000400:1.0:1789181501.232647:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789181501.232650:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c1e00841800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181501.232654:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 258 00000100:00080000:1.0:1789181501.232660:0:3643:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c1e00841800 using connection 192.168.202.101@tcp/0@lo 00010000:00020000:3.0:1789181501.232663:0:6521:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789181501.232675:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f06a00 x1876092408466432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181501.232692:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408465664:0@lo:400:kworker.0 00000100:00100000:3.0:1789181501.232697:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876092408466304:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 49us (197us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789181501.232704:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789181501.232742:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876092408466432:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789181501.232769:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789181501.237642:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de430e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789181501.237656:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789181501.237661:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876092408466304:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789181501.237811:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408466432 00000100:00100000:2.0:1789181501.237821:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408466432 00000100:00100000:2.0:1789181501.237867:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789181501.237874:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876092408466432:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1789181501.237898:0:6523:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789181501.237975:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876092408466432:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 99us (5204us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789181501.237982:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1789181501.238070:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1e00841800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789181501.238075:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789181501.238078:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876092408466432:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1789181502.029499:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181503.053574:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181503.054624:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1789181503.868001:0:15357:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789181503.895920:0:15357:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789181503.895980:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.895997:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.896006:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.896014:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.896048:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789181503.896054:0:15357:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789181503.896080:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789181503.896454:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789181503.896462:0:15357:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789181503.896473:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9c1de430e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789181503.896479:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789181503.896481:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789181503.896485:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789181503.897631:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897647:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897671:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897677:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897702:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789181503.897709:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897716:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897747:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897754:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897776:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789181503.897783:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897789:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897795:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897812:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897820:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789181503.897825:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897832:0:15357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897838:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897844:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181503.897852:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1789181503.897855:0:15357:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789181503.897884:0:15357:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789181503.897888:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789181503.897892:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181503.897898:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789181503.897905:0:15357:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9c1cc1d2a000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789181503.897912:0:15357:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9c1dfaf41000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789181503.897917:0:15357:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9c1dd9303380) has exports, disconnecting them 00000020:00080000:3.0:1789181503.897922:0:15357:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c1cc1d2a000), last request at 1789181501 00000020:00000080:3.0:1789181503.897930:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516ec2 00000100:00080000:3.0:1789181503.897950:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d2d000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789181503.898011:0:15357:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1cc1d2a000): rc 0 00000020:00000080:3.0:1789181503.898014:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1cc1d2a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789181503.898022:0:15357:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c1dfaf41000), last request at 1789181501 00000020:00000080:3.0:1789181503.898026:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516d9c 00000100:00080000:3.0:1789181503.898031:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf40000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789181503.898041:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc1d2a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789181503.898079:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc1d2d000 for lustre-MDT0001 00010000:00010000:2.0:1789181503.898258:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789181503.898266:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898274:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a800 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181503.898277:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898285:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181503.898293:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181503.898309:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789181503.898311:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789181503.898314:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789181503.898348:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898354:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181503.898377:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898385:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a800/0x76fb555283517020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517027 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898409:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789181503.898414:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898419:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658b200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181503.898422:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898429:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181503.898434:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181503.898439:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789181503.898441:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1789181503.898443:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1789181503.898463:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898469:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181503.898475:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898481:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658b200/0x76fb55528351702e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283517035 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898490:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789181503.898493:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898498:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0a00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181503.898501:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898508:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181503.898514:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181503.898519:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789181503.898521:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789181503.898523:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789181503.898532:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898538:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181503.898553:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898564:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0a00/0x76fb555283516efa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516f01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898577:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181503.898580:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898586:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658ac00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181503.898588:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898595:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181503.898602:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181503.898607:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789181503.898609:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789181503.898610:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789181503.898622:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898627:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181503.898632:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898638:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ac00/0x76fb555283517288 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb55528351728f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898655:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181503.898658:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898664:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a000 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181503.898667:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898674:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181503.898680:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181503.898685:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789181503.898687:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789181503.898689:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789181503.898700:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898705:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181503.898709:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898715:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658a000/0x76fb555283516be3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x76fb555283516bea expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.898747:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181503.898749:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181503.898756:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181503.898774:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408466688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181503.898848:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181503.898899:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789181503.898906:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408466560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181503.898929:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181503.898947:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408467072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181503.898966:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181503.898992:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408466816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181503.899014:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181503.899032:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181503.899037:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408466944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181503.899056:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181503.899078:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408466688 00010000:00010000:1.0:1789181503.899248:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181503.899263:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408466560 00000100:00100000:1.0:1789181503.899269:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408466560 00000100:00100000:1.0:1789181503.899301:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408467072 00000100:00100000:1.0:1789181503.899304:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408467072 00000100:00100000:1.0:1789181503.899312:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408466816 00000100:00100000:1.0:1789181503.899314:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408466816 00000100:00100000:1.0:1789181503.899321:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408466944 00000100:00100000:1.0:1789181503.899322:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408466944 00000100:00100000:1.0:1789181503.899332:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789181503.899339:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc66fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1876092408466560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789181503.899344:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789181503 with bad export cookie 8573540128508701408 00010000:00010000:0.0:1789181503.900258:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789181503.900372:0:15357:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1dfaf41000): rc 0 00000020:00000080:3.0:1789181503.900376:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf41000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789181503.900392:0:15357:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa94541577ae0 00000020:00000080:3.0:1789181503.900417:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf41000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789181503.900448:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1dfaf40000 for lustre-MDT0001 00000100:00080000:3.0:1789181503.900471:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789181503.900480:0:15357:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9c1dc4378700 x1876092408464640/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789181516 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181503.900509:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1789181503.901271:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408466688 00000100:00100000:2.0:1789181503.901317:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789181503.901325:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876092408467072:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789181503.901330:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789181503 with bad export cookie 8573540128508701408 00000100:00100000:2.0:1789181503.901430:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876092408467072:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (2461us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789181503.901436:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789181503.901455:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789181503.901459:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1876092408466816:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789181503.901463:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789181503 with bad export cookie 8573540128508701408 00000100:00100000:2.0:1789181503.901491:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1876092408466816:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (2476us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789181503.901514:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789181503.901527:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789181503.901531:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1876092408466944:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789181503.901535:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789181503 with bad export cookie 8573540128508701408 00000100:00100000:2.0:1789181503.901561:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1876092408466944:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (2505us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789181503.901567:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789181503.901578:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789181503.901582:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876092408466688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789181503.901586:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789181503 with bad export cookie 8573540128508701408 00000100:00100000:2.0:1789181503.901608:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876092408466688:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (2760us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789181503.901613:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789181503.901663:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789181503.901668:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9c1de60e2800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789181503.901672:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789181503.902801:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789181503.904332:0:15357:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789181503.904345:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9c1df9d2c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789181503.905622:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789181503.905630:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789181503.905655:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789181503.905737:0:15357:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789181503.905771:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9c1e00920800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789181503.905789:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789181503.905791:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789181503.905800:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789181503.905861:0:15357:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789181503.905870:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9c1de7d93000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789181503.905912:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9c1dd9303380) has no exports 00000100:00100000:1.0:1789181503.908043:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408467200:0@lo:9:umount.0 00000100:00100000:1.0:1789181503.908125:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181503.908171:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408467328:0@lo:9:umount.0 00000100:00100000:1.0:1789181503.908195:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181503.908473:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408467200 00000100:00100000:1.0:1789181503.908481:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408467200 00000100:00100000:1.0:1789181503.908538:0:8629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408467328 00000100:00100000:1.0:1789181503.908541:0:8629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408467328 00000100:00100000:1.0:1789181503.908585:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789181503.908595:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876092408467200:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789181503.908622:0:8629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516de9 00000100:00080000:1.0:1789181503.908632:0:8629:0:(import.c:65:import_set_state_nolock()) ffff9c1e00b96800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789181503.908677:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789181503.908855:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3642:x1876092408467200:12345-0@lo:9:umount.0 Request processed in 261us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181503.908863:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789181503.908880:0:8629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789181503.908887:0:8629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876092408467328:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789181503.908898:0:8629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516f2b 00000100:00080000:1.0:1789181503.908904:0:8629:0:(import.c:65:import_set_state_nolock()) ffff9c1df9d35800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789181503.908925:0:8629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1789181503.909001:0:8629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3642:x1876092408467328:12345-0@lo:9:umount.0 Request processed in 115us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181503.909008:0:8629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789181503.909026:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181503.909030:0:6517:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789181503.909044:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181503.909074:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1e00920800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789181503.909087:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789181503.909090:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789181503.909093:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408467200:0@lo:9:umount.0 00000100:00080000:1.0:1789181503.909106:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7d93000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789181503.909110:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789181503.909111:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789181503.909114:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408467328:0@lo:9:umount.0 00010000:00010000:1.0:1789181503.909143:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181503.913673:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc66fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1876092408466560:12345-0@lo:103:ldlm_bl.0 Request processed in 14321us (14729us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789181503.913690:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789181503.923984:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.101@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789181503.923990:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789181503.924002:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc4379f80 x1876092408464896/t0(0) o400->MGC192.168.202.101@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789181517 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181503.924016:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc4302680 x1876092408466688/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789181519 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181503.924025:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc4301180 x1876092408466560/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789181519 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181503.924033:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc4301f80 x1876092408467072/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789181519 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181503.924061:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc4300700 x1876092408466816/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789181519 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181503.924070:0:3644:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc4302300 x1876092408466944/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789181519 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789181503.924079:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789181503.924082:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789181503.924083:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789181503.924325:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c1de60e2800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789181503.924352:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408466816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181503.924361:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408464896:0@lo:400:kworker.0 00000100:00100000:0.0:1789181503.924367:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408464640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181503.924412:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da575344-f445-48a7-8532-0e6efd2ea878:3645:1876092408466944:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789181503.924458:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9c1de60e2800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789181503.924463:0:3644:0:(import.c:545:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 190 00000100:00080000:2.0:1789181503.924477:0:3644:0:(import.c:666:import_select_connection()) MGC192.168.202.101@tcp: import ffff9c1de60e2800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1789181503.924508:0:3644:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dff851f80 x1876092408467456/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789181503.924544:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408466688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181503.924559:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408466560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181503.924564:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da575344-f445-48a7-8532-0e6efd2ea878:3644:1876092408467072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181503.924620:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da575344-f445-48a7-8532-0e6efd2ea878:3642:1876092408467456:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1789181503.924671:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876092408467456 offset 0 length 520: 4 00000020:00080000:3.0:1789181503.935180:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9c1dd9303380) has no exports 00000020:01000000:2.0:1789181503.995455:0:15357:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c1dc4374ea0 - data ffff9c1de4b72bd0/ffff9c1dfb2d0800 00000020:01000000:2.0:1789181503.995673:0:15357:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c1dd8285240 - data ffff9c1de49a6a20/ffff9c1dfaf3c800 00000001:00000004:2.0:1789181504.012679:0:15357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:2.0:1789181504.076621:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181504.089825:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789181504.089836:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789181504.089845:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789181504.091685:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789181504.091693:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1789181504.091714:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789181504.091717:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789181504.092902:0:8615:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789181504.092910:0:8615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789181504.092923:0:8615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789181504.094678:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789181504.094687:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1789181504.094826:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789181504.094831:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789181504.095858:0:9985:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789181504.095863:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789181504.095877:0:9985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789181504.097679:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516c06 00000020:00000080:3.0:1789181504.097691:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1df9d31000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789181504.097791:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df9d31000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789181504.099942:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516c1b 00000020:00000080:3.0:1789181504.100216:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1df9d36000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789181504.100229:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789181504.100238:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df9d36000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1789181504.100251:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181504.100260:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789181504.100265:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9c1dd9300000) has no exports 00000004:01000000:3.0:1789181504.100508:0:15357:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789181504.100519:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516f24 00000020:00000080:3.0:1789181504.100523:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1cc3268000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789181504.100531:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789181504.100538:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc3268000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789181504.100548:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181504.100557:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789181504.100559:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff9c1dfaf4b380) has no exports 00000020:00000080:3.0:1789181504.100573:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516f1d 00000020:00000080:3.0:1789181504.100577:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1de7d91000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789181504.100589:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7d91000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789181504.101535:0:15357:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789181504.101543:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789181504.101548:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1789181504.101555:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789181504.101557:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789181504.101584:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1de7d93000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789181504.101618:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789181504.101629:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789181504.101633:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1de7f49800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789181504.101636:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7f49800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1789181504.101641:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789181504.101720:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516de2 00000020:00000080:3.0:1789181504.101746:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1de7f4f800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789181504.101754:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789181504.101761:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7f4f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789181504.101769:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181504.101774:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789181504.101777:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9c1e009519c0) has no exports 00000020:00000080:3.0:1789181504.101782:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516ddb 00000020:00000080:3.0:1789181504.101785:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1e00922800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789181504.102597:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1e00922800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789181504.103309:0:15357:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789181504.103315:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789181504.103319:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1789181504.103325:0:15357:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789181504.103327:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789181504.103351:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1e00920800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789181504.103408:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789181504.103420:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789181504.103426:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1cc1dce000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789181504.103428:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc1dce000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1789181504.103433:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789181504.103518:0:15357:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789181504.103525:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516c3e 00000020:00000080:3.0:1789181504.103532:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf22000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789181504.103540:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789181504.103547:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf22000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789181504.103556:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181504.103560:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789181504.103564:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9c1dd13e99c0) has no exports 00000020:00000080:3.0:1789181504.103570:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516c37 00000020:00000080:3.0:1789181504.103574:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1df9d2c800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789181504.103583:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df9d2c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789181504.106038:0:15357:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1789181504.106178:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789181504.106183:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1789181504.106191:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789181504.106221:0:27:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1df9d2c000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789181504.106268:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789181504.106295:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789181504.106301:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1df9d28000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789181504.106305:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df9d28000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789181504.106322:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789181504.106492:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789181504.106497:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789181504.106499:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1dd36be800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789181504.106502:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dd36be800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789181504.106506:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789181504.106837:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516c22 00000020:00000080:2.0:1789181504.106846:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1df9d34000/lustre-MDD0001_UUID 00000020:01000000:2.0:1789181504.106855:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1789181504.106865:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df9d34000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789181504.106874:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789181504.106880:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789181504.106883:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9c1dd93019c0) has no exports 00000020:00000080:2.0:1789181504.106902:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789181504.106905:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1789181504.106907:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1df9d36800/lustre-MDD0001_UUID 00000020:00000080:2.0:1789181504.106910:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df9d36800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789181504.106913:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1789181504.107417:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516c29 00000020:00000080:2.0:1789181504.107424:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1df9d34800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789181504.107443:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df9d34800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:2.0:1789181504.107455:0:15357:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1df1a64800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1789181504.107459:0:15357:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1df1a64800 2 00000020:01000004:2.0:1789181504.107462:0:15357:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c1df1a64800 from lustre-MDT0001 00000020:00000080:2.0:1789181504.107480:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789181504.107484:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1789181504.107487:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1df9d30000/lustre-MDT0001_UUID 00000020:00000080:2.0:1789181504.107488:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df9d30000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1789181504.107503:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1789181504.107819:0:15357:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1789181504.107824:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1789181504.107827:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789181504.107831:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789181504.107840:0:15357:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9c1dfaf25800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789181504.107846:0:15357:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9c1dfaf4cd40) has exports, disconnecting them 00000020:00080000:2.0:1789181504.107851:0:15357:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9c1dfaf25800), last request at 1789181254 00000020:00000080:2.0:1789181504.107855:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516c7d 00000020:00080000:2.0:1789181504.107868:0:15357:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1dfaf25800): rc 0 00000020:00000080:2.0:1789181504.107871:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf25800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789181504.107896:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf25800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1789181504.197936:0:15357:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1789181504.197945:0:15357:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789181504.197951:0:15357:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789181504.197959:0:15357:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789181504.198404:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789181504.198415:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1789181504.198424:0:15357:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1df1a64800 1 00000020:00000080:3.0:1789181504.198431:0:15357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516bb9 00000020:00000080:3.0:1789181504.198442:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1de7e62800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1789181504.198448:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1789181504.198453:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181504.198456:0:15357:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789181504.198460:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9c1dd13eb380) has no exports 00000020:00000080:3.0:1789181504.204247:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1de430e800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789181504.204266:0:265:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf27000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1789181504.204283:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf27000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1789181504.204297:0:265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1789181504.204604:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7e62800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789181504.324016:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789181504.324031:0:15357:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789181504.324037:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1df1a63000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789181504.324041:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1df1a63000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789181504.324057:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789181504.324177:0:15357:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c1df1a66000 00000020:01000000:1.0:1789181504.324201:0:15357:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789181504.324205:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181504.324210:0:15357:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789181504.324214:0:15357:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9c1dd13e8000) has no exports 00000100:00100000:0.0:1789181504.324368:0:6522:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9c1dd2242000:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1789181504.324400:0:14725:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9c1cc4575e00:14725] 4 exiting: rc = 0 00000100:00100000:2.0:1789181504.324486:0:6523:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9c1dc8c01600:6523] 2 exiting: rc = 0 00000100:00100000:0.0:1789181504.324512:0:6521:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9c1dd2242c00:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1789181504.324585:0:9021:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9c1dfb320c00:9021] 3 exiting: rc = 0 00000100:00100000:0.0:1789181504.331885:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331897:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331902:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331908:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331914:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331920:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331926:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331932:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331938:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331943:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331949:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331954:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331959:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331966:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331971:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331976:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331982:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331988:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331993:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.331998:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332003:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332009:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332014:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332019:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332024:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332030:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332036:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332041:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332069:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332075:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332081:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332086:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332091:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332097:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332102:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332108:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332114:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332119:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332125:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332132:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332137:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332142:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332148:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332153:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332158:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332163:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332168:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332173:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332179:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332188:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332194:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332200:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332205:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332211:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332216:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332420:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332427:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332433:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332439:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332444:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332450:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332455:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332461:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.332480:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.343388:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c1dc2b35c00:6525] 1 exiting: rc = 0 00000100:00100000:2.0:1789181504.344478:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c1dcf525600:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1789181504.344599:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344609:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344616:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344622:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344627:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344633:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344639:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344656:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344663:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344670:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344677:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344684:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344691:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344696:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344702:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344707:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344712:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344718:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344751:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344758:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344764:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344770:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344776:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344782:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344787:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344792:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344797:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344803:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344816:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344823:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344841:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344847:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344852:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344857:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344862:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344868:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344872:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344877:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344883:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344888:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344894:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344899:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344905:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344910:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344915:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344920:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344925:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344930:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344936:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344941:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344946:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344951:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344956:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344961:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344967:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344973:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344978:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344983:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344989:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.344997:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.345003:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.345010:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.345513:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.345522:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.348484:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9c1dd2240400:6527] 1 exiting: rc = 0 00000100:00100000:1.0:1789181504.351584:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9c1dd83f7200:6526] 0 exiting: rc = 1 00000100:00100000:2.0:1789181504.352690:0:7854:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9c1dfb0efc00:7854] 2 exiting: rc = 0 00000100:00100000:3.0:1789181504.356352:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356401:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356412:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356419:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356424:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356432:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356438:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356445:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356451:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356456:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356475:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356482:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356488:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356494:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356500:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356507:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356513:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356519:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356525:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356530:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356537:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356542:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356563:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356570:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356576:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356582:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356588:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356595:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356601:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356607:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356613:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356619:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356624:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356630:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356652:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356680:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356685:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356691:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356699:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356708:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356714:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356720:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356778:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356783:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356789:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356795:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356817:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356824:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356831:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356838:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356845:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356852:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356857:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356864:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356869:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356875:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356881:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356898:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356905:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356912:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356918:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356923:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356928:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.356942:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181504.378225:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c1dcf524400:6528] 0 exiting: rc = 1 00000100:00100000:1.0:1789181504.378566:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c1dd83f6800:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1789181504.378669:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378677:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378682:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378688:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378693:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378698:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378719:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378749:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378755:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378760:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378764:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378770:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378775:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378780:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378785:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378790:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378795:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378801:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378806:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378811:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378816:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378821:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378826:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378832:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378837:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378842:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378847:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378851:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378857:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378862:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378867:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378872:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378877:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378883:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378888:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378894:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378898:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378903:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378908:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378914:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378918:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378932:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378936:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378941:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378946:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378950:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378954:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378959:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378964:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378968:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378973:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378977:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378981:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378986:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378991:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378995:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.378999:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.379003:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.379007:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.380331:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.380351:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.380357:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.380362:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.380368:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.381424:0:6530:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c1dd83f6200:6530] 0 exiting: rc = 1 00000100:00100000:2.0:1789181504.381570:0:6531:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c1dd83f6600:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1789181504.381675:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381682:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381688:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381693:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381699:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381705:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381710:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381716:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381792:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381799:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381805:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381810:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381831:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381835:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381840:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381845:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381849:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381853:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381858:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381863:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381868:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381873:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381879:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381884:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381889:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381895:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381901:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381907:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381912:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381917:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381921:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381926:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381931:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381936:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381942:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381947:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381952:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381957:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381962:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381967:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381971:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381976:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381981:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381986:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381990:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381994:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.381999:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382179:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382188:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382193:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382198:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382203:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382208:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382213:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382218:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382222:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382227:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382232:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382237:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382242:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382247:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382252:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382257:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181504.382262:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789181504.390789:0:6532:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c1dd2244600:6532] 0 exiting: rc = 1 00000100:00100000:2.0:1789181504.390952:0:6533:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c1dc910d000:6533] 1 exiting: rc = 0 00000100:00100000:1.0:1789181504.391090:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391098:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391103:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391109:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391115:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391120:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391126:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391132:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391139:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391163:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391168:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391174:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391179:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391185:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391190:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391196:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391201:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391207:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391212:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391217:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391222:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391228:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391233:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391239:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391245:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391250:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391256:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391261:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391265:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391270:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391275:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391280:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391285:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391290:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391296:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391300:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391306:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391311:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391317:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391322:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391327:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391332:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391337:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391342:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391355:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391361:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391366:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391371:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391376:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391382:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391397:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391408:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391413:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391419:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391424:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391429:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391433:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391438:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391442:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391447:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391452:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391456:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391470:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.391476:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789181504.392197:0:6534:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9c1dd220f400:6534] 0 exiting: rc = 1 00000100:00100000:2.0:1789181504.392416:0:6536:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9c1dd1369a00:6536] 2 exiting: rc = 0 00000100:00100000:0.0:1789181504.392888:0:6535:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9c1dd1368e00:6535] 1 exiting: rc = 0 00000100:00100000:1.0:1789181504.393034:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393186:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393193:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393199:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393205:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393212:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393218:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393223:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393229:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393235:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393258:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393264:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393270:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393276:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393281:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393296:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393301:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393307:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393316:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393322:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393328:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393333:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393339:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393345:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393351:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393357:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393363:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393370:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393377:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393383:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393400:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393408:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393413:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393420:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393440:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393447:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393452:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393458:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393465:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393470:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393476:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393483:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393489:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393494:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393499:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393505:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393510:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393516:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393521:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393527:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393540:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393545:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393551:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393557:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393562:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393567:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393572:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393578:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393586:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393592:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393598:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393603:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393609:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181504.393617:0:15357:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789181504.405058:0:15357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181504.405074:0:15357:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789181504.405080:0:15357:0:(genops.c:885:class_export_put()) final put ffff9c1de60e1800/MDS_uuid 00000020:00000080:0.0:1789181504.405085:0:15357:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de60e1800/MDS_uuid for MDS 00000020:01000000:0.0:1789181504.405099:0:15357:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789181504.405287:0:15357:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789181505.099891:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181506.124395:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181506.315830:0:1011:0:(pinger.c:229:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789181506.315841:0:1011:0:(pinger.c:247:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181506.315844:0:1011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789181506.315847:0:1011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789181506.315852:0:1011:0:(import.c:65:import_set_state_nolock()) ffff9c1cc2474800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181506.315860:0:1011:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 457 00000100:00080000:1.0:1789181506.315866:0:1011:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789181506.315880:0:1011:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c1cc2474800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181506.315920:0:1011:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f07b80 x1876092408467584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789181506.315967:0:1011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789181506.315971:0:1011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789181506.315972:0:1011:0:(import.c:65:import_set_state_nolock()) ffff9c1e00841800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181506.315990:0:1011:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 457 00000100:00080000:1.0:1789181506.315992:0:1011:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789181506.315998:0:1011:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c1e00841800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181506.316010:0:1011:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f05180 x1876092408467840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181506.316071:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408467712:0@lo:400:kworker.0 00000400:00000100:1.0:1789181506.316135:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408467712 offset 0 length 224: 4 00000100:00100000:1.0:1789181506.316214:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181506.316223:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408467968:0@lo:400:kworker.0 00000400:00000100:1.0:1789181506.316316:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408467968 offset 0 length 224: 4 00000100:00100000:0.0:1789181506.316491:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876092408467584:0@lo:38:kworker.0 00000400:00000100:0.0:1789181506.316515:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408467584 offset 0 length 520: 4 00000100:00100000:0.0:1789181506.316529:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876092408467840:0@lo:38:kworker.0 00000400:00000100:0.0:1789181506.316543:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408467840 offset 0 length 520: 4 00010000:00010000:2.0:1789181507.150419:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181508.176084:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181508.363895:0:1011:0:(pinger.c:229:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789181508.363905:0:1011:0:(pinger.c:247:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181508.363908:0:1011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789181508.363913:0:1011:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181508.363970:0:1011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789181508.363974:0:1011:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789181508.364032:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408468224:0@lo:400:kworker.0 00000400:00000100:1.0:1789181508.364092:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408468224 offset 0 length 224: 4 00000100:00100000:0.0:1789181508.364337:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181508.364349:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408468096:0@lo:400:kworker.0 00000400:00000100:0.0:1789181508.364384:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408468096 offset 0 length 224: 4 00000020:01000004:3.0:1789181508.868384:0:15558:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789181508.882852:0:15558:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789181508.882906:0:15558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181508.882920:0:15558:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181508.882929:0:15558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181508.882936:0:15558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181508.882955:0:15558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789181508.882961:0:15558:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789181508.883002:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789181508.883014:0:15558:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc2f07b80 x1876092408467584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789181521 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181508.883032:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789181508.883040:0:15558:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789181508.883046:0:15558:0:(import.c:65:import_set_state_nolock()) ffff9c1cc2474800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789181508.883052:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789181508.883056:0:15558:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc2f07b80 x1876092408467584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789181521 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181508.883063:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789181508.883066:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1789181508.883155:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876092408467584:0@lo:38:kworker.0 00010000:00010000:1.0:1789181508.883306:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181508.883314:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181508.883334:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f0800 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:1.0:1789181508.883338:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181508.884597:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181508.884617:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181508.884624:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789181508.884703:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789181508.884707:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789181508.884742:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1de60e2800 00010000:00010000:1.0:1789181508.884746:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181508.884753:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e021f0800/0x76fb555283517004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb55528351700b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181508.884766:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181508.884768:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181508.884770:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789181508.887293:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789181508.887313:0:15558:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc2f05c00 x1876092408467712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181522 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181508.887345:0:15558:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc2f07100 x1876092408468096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181524 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181508.887369:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789181508.887376:0:15558:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789181508.887407:0:15558:0:(import.c:65:import_set_state_nolock()) ffff9c1e00b92000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789181508.887571:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408468096:0@lo:400:kworker.0 00000100:00100000:0.0:1789181508.887797:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876092408468352:0@lo:39:umount.0 00000400:00000100:0.0:1789181508.887858:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408468352 offset 0 length 224: 4 00000100:00100000:1.0:1789181508.888227:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408467712:0@lo:400:kworker.0 00010000:00010000:2.0:1789181509.199963:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789181509.905375:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789181509.905386:0:9516:0:(genops.c:885:class_export_put()) final put ffff9c1de7d92000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789181509.905410:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7d92000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789181509.905450:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1df9d35800 for lustre-OST0001 00000001:00100000:0.0:1789181509.920777:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789181509.920788:0:8431:0:(genops.c:885:class_export_put()) final put ffff9c1e00b95800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789181509.920834:0:12254:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1e00b95800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789181509.920877:0:12254:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1e00b96800 for lustre-OST0000 00010000:00010000:1.0:1789181510.219896:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181511.244053:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181511.371859:0:1011:0:(pinger.c:229:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789181511.371869:0:1011:0:(pinger.c:247:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181511.371889:0:1011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789181511.371893:0:1011:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789181511.372001:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408468480:0@lo:400:kworker.0 00000400:00000100:1.0:1789181511.372070:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408468480 offset 0 length 224: 4 00010000:00010000:2.0:1789181512.270663:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181513.292122:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181513.996122:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181503/real 1789181503] req@ffff9c1dff851f80 x1876092408467456/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789181513 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181513.996941:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1dff851f80 x1876092408467456/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789181513 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789181513.996965:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de60e2800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181513.996982:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789181513.996986:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da575344-f445-48a7-8532-0e6efd2ea878:3642:1876092408467456:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1789181513.997021:0:12254:0:(pinger.c:229:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789181513.997026:0:12254:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789181513.997029:0:12254:0:(import.c:65:import_set_state_nolock()) ffff9c1de60e2800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181513.997033:0:12254:0:(import.c:545:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1789181513.997038:0:12254:0:(import.c:630:import_select_connection()) MGC192.168.202.101@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789181513.997048:0:12254:0:(import.c:666:import_select_connection()) MGC192.168.202.101@tcp: import ffff9c1de60e2800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181513.997091:0:12254:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3848000 x1876092408468608/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181513.997109:0:12254:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789181513.997112:0:12254:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789181513.997247:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181513.997263:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408468736:0@lo:400:kworker.0 00000400:00000100:1.0:1789181513.997331:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408468736 offset 0 length 224: 4 00000100:00100000:0.0:1789181513.997358:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da575344-f445-48a7-8532-0e6efd2ea878:3642:1876092408468608:0@lo:250:kworker.0 00000400:00000100:0.0:1789181513.997387:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876092408468608 offset 0 length 520: 4 00010000:00010000:1.0:1789181514.315934:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181515.340052:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181516.363941:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181517.387874:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181518.093058:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181508/real 1789181508] req@ffff9c1cc4470e00 x1876092408468352/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789181518 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181518.093109:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1cc4470e00 x1876092408468352/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789181518 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789181518.093159:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1e00b92000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789181518.093187:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876092408468352:0@lo:39:umount.0 00000100:00080000:3.0:1789181518.093275:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789181518.093281:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789181518.093286:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789181518.094244:0:15558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.094285:0:15558:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.094293:0:15558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.094298:0:15558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.094324:0:15558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181518.094331:0:15558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.094337:0:15558:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.094343:0:15558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.094348:0:15558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.094363:0:15558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789181518.094368:0:15558:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789181518.094392:0:15558:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789181518.094396:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789181518.094400:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181518.094406:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789181518.094410:0:15558:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9c1e00953380) has no exports 00000020:00080000:3.0:1789181518.094442:0:15558:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9c1e00953380) has no exports 00010000:00010000:1.0:1789181518.094466:0:13192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181518.094477:0:13192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.094485:0:13192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e021f1a00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:1.0:1789181518.094489:0:13192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.094498:0:13192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181518.094505:0:13192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181518.094510:0:13192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789181518.094513:0:13192:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789181518.094515:0:13192:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789181518.094538:0:13192:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1de60e2800 00010000:00010000:1.0:1789181518.094542:0:13192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.094550:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1a00/0x76fb555283517012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283517019 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.094565:0:13192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181518.094568:0:13192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.094574:0:13192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:1.0:1789181518.094577:0:13192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.094584:0:13192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181518.094590:0:13192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181518.094595:0:13192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789181518.094597:0:13192:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789181518.094599:0:13192:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789181518.094604:0:13192:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1de60e2800 00010000:00010000:1.0:1789181518.094606:0:13192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.094612:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb55528351727a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283517281 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.094631:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181518.094633:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181518.094634:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789181518.096103:0:15558:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c1cc1faf2a0 - data ffff9c1de4b711b0/ffff9c1cc31c6800 00000020:01000000:3.0:1789181518.096244:0:15558:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c1dd17caea0 - data ffff9c1de4ac9948/ffff9c1cc26f3000 00010000:00010000:2.0:1789181518.098014:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789181518.114249:0:15558:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789181518.126971:0:15558:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516d56 00000020:00000080:0.0:1789181518.126985:0:15558:0:(genops.c:885:class_export_put()) final put ffff9c1cc1dce800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789181518.127001:0:12254:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc1dce800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1789181518.127012:0:15558:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1dfb02c800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789181518.127016:0:15558:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1dfb02c800 2 00000020:01000004:0.0:1789181518.127186:0:15558:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c1dfb02c800 from lustre-OST0000 00000020:00000080:0.0:1789181518.127212:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181518.127235:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789181518.127239:0:15558:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf22800/lustre-OST0000_UUID 00000020:00000080:0.0:1789181518.127241:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf22800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789181518.127247:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789181518.127320:0:15558:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789181518.127325:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789181518.127328:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181518.127333:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789181518.127341:0:15558:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c1de7e64800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789181518.127347:0:15558:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9c1de7f23380) has exports, disconnecting them 00000020:00080000:0.0:1789181518.127352:0:15558:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c1de7e64800), last request at 1789181275 00000020:00000080:0.0:1789181518.127356:0:15558:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516d80 00000020:00080000:0.0:1789181518.127366:0:15558:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1de7e64800): rc 0 00000020:00000080:0.0:1789181518.127372:0:15558:0:(genops.c:885:class_export_put()) final put ffff9c1de7e64800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789181518.127392:0:12254:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7e64800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789181518.128298:0:15558:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789181518.128309:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789181518.128314:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789181518.128320:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789181518.128343:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc2474800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789181518.128519:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789181518.128527:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789181518.128531:0:15558:0:(genops.c:885:class_export_put()) final put ffff9c1e00b93000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789181518.128534:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1e00b93000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789181518.128545:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789181518.128597:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789181518.128601:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181518.128606:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789181518.128612:0:15558:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c1dfaf45800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789181518.128618:0:15558:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff9c1dc4e00000) has exports, disconnecting them 00000020:00080000:1.0:1789181518.128622:0:15558:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c1dfaf45800), last request at 1789181275 00000020:00000080:1.0:1789181518.128626:0:15558:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516d95 00000020:00080000:1.0:1789181518.128637:0:15558:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1dfaf45800): rc 0 00000020:00000080:1.0:1789181518.128641:0:15558:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf45800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789181518.128662:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf45800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789181518.130982:0:15558:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789181518.130991:0:15558:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789181518.130997:0:15558:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789181518.131004:0:15558:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789181518.131044:0:265:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1e00b92000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789181518.131226:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789181518.131235:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789181518.131240:0:15558:0:(genops.c:885:class_export_put()) final put ffff9c1de7e61000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789181518.131244:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de7e61000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789181518.131250:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789181518.131320:0:15558:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1dfb02c800 1 00000020:00000080:3.0:1789181518.131327:0:15558:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516d1e 00000020:00000080:3.0:1789181518.131333:0:15558:0:(genops.c:885:class_export_put()) final put ffff9c1dfb1dc800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789181518.131340:0:15558:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789181518.131348:0:265:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfb1dc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789181518.131358:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181518.131363:0:15558:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789181518.131367:0:15558:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9c1de7f20000) has no exports 00000020:00000080:3.0:1789181518.177572:0:15558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789181518.177587:0:15558:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789181518.177592:0:15558:0:(genops.c:885:class_export_put()) final put ffff9c1dfb029000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789181518.177597:0:15558:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfb029000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789181518.177608:0:15558:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789181518.177751:0:15558:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c1dfb02d800 00000020:02000400:3.0:1789181518.177810:0:15558:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789181518.412076:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789181519.115993:0:12254:0:(pinger.c:229:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789181519.116005:0:12254:0:(pinger.c:247:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181519.116008:0:12254:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789181519.116010:0:12254:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789181519.116154:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408468864:0@lo:400:kworker.0 00000400:00000100:3.0:1789181519.116227:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408468864 offset 0 length 224: 4 00010000:00010000:1.0:1789181519.436244:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181520.461222:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181521.172659:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181506/real 1789181506] req@ffff9c1dc2f05180 x1876092408467840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789181521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181521.172690:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1dc2f05180 x1876092408467840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789181521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789181521.172710:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1e00841800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789181521.172755:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789181521.172760:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876092408467840:0@lo:38:kworker.0 00000100:00080000:3.0:1789181521.172791:0:12865:0:(pinger.c:229:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789181521.172796:0:12865:0:(pinger.c:247:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789181521.172799:0:12865:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789181521.172802:0:12865:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789181521.172805:0:12865:0:(import.c:65:import_set_state_nolock()) ffff9c1e00841800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789181521.172810:0:12865:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1789181521.172815:0:12865:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789181521.172827:0:12865:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c1e00841800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181521.172868:0:12865:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc4471880 x1876092408468992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789181521.172936:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876092408468992:0@lo:38:kworker.0 00000400:00000100:3.0:1789181521.172982:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408468992 offset 0 length 520: 4 00000100:00100000:0.0:1789181521.173202:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408469120:0@lo:400:kworker.0 00000400:00000100:0.0:1789181521.173227:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408469120 offset 0 length 224: 4 00010000:00010000:1.0:1789181521.485283:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1789181522.194588:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181506/real 1789181506] req@ffff9c1dc2f04a80 x1876092408467968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789181522 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.247961:0:3646:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9c1dc2f04a80 x1876092408467968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789181522 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789181522.247978:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9c1cc326c000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789181522.248237:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789181522.278906:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1789181522.278957:0:12865:0:(pinger.c:229:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789181522.278964:0:12865:0:(pinger.c:247:ptlrpc_pinger_process_import()) da575344-f445-48a7-8532-0e6efd2ea878->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789181522.278967:0:12865:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789181522.278970:0:12865:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789181522.278973:0:12865:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789181522.278976:0:12865:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789181522.278979:0:12865:0:(import.c:65:import_set_state_nolock()) ffff9c1cc326c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789181522.279050:0:12865:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 258 00000100:00080000:3.0:1789181522.279067:0:12865:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c1cc326c000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181522.279108:0:12865:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc4470a80 x1876092408469248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789181522.279185:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408467968:0@lo:400:kworker.0 00000100:00100000:0.0:1789181522.279338:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876092408469248:0@lo:38:kworker.0 00000400:00000100:0.0:1789181522.279396:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092408469248 offset 0 length 520: 4 00000020:01000004:2.0:1789181522.390519:0:15760:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789181522.411179:0:15760:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789181522.411254:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.411270:0:15760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.411288:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.411296:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.411324:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789181522.411329:0:15760:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789181522.411354:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789181522.411367:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1cc4471880 x1876092408468992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789181541 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181522.411385:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789181522.411392:0:15760:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789181522.411399:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9c1e00841800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789181522.411404:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789181522.411407:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1cc4471880 x1876092408468992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789181541 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181522.411432:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789181522.411436:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:0.0:1789181522.411636:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876092408468992:0@lo:38:kworker.0 00010000:00010000:3.0:1789181522.411710:0:13192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181522.411718:0:13192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.411753:0:13192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e800 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181522.411763:0:13192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.411772:0:13192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181522.411778:0:13192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181522.411784:0:13192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789181522.411786:0:13192:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789181522.411788:0:13192:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789181522.411802:0:13192:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1de60e2800 00010000:00010000:3.0:1789181522.411806:0:13192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.411815:0:13192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb555283516fe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283516fef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.411826:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181522.411828:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181522.411829:0:13192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789181522.415102:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789181522.415124:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc2f06680 x1876092408468224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181524 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.415151:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc2f05c00 x1876092408468480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181527 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.415171:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1cc384b800 x1876092408468736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181529 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.415185:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1cc3848e00 x1876092408468864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181535 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.415209:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1cc4470700 x1876092408469120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181537 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.415217:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1cc4470a80 x1876092408469248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789181532 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.415239:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1789181522.415277:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408468864:0@lo:400:kworker.0 00000100:00100000:3.0:1789181522.415288:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1876092408468736:0@lo:400:kworker.0 00000100:00080000:3.0:1789181522.415322:0:15760:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789181522.415327:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9c1cc326c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789181522.415333:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789181522.415337:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc2f06680 x1876092408468224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181524 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.415345:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1dc2f05c00 x1876092408468480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181527 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.415352:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1cc4470700 x1876092408469120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181537 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.415360:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1cc4470a80 x1876092408469248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789181532 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181522.415366:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789181522.415369:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789181522.415425:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408469120:0@lo:400:kworker.0 00000100:00100000:0.0:1789181522.415452:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408468224:0@lo:400:kworker.0 00000100:00100000:0.0:1789181522.415486:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876092408469248:0@lo:38:kworker.0 00000100:00100000:2.0:1789181522.415544:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1876092408468480:0@lo:400:kworker.0 00010000:00010000:3.0:1789181522.421158:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.421179:0:15760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.421205:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.421212:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.421287:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181522.421296:0:15760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.421303:0:15760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.421309:0:15760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181522.421315:0:15760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.425802:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181522.425821:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.425834:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f800 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181522.425839:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.425850:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181522.425858:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181522.425864:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789181522.425868:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789181522.425882:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1de60e2800 00010000:00010000:2.0:1789181522.425886:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.425893:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f800/0x76fb555283516ff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283516ffd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.425910:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181522.425914:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.425942:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084ba00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181522.425945:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.425953:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181522.425959:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181522.425964:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789181522.425966:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789181522.425971:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1de60e2800 00010000:00010000:2.0:1789181522.425973:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.425980:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181522.425982:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181522.425984:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181522.426100:0:15760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789181522.426109:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ba00/0x76fb55528351726c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283517273 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181522.426127:0:15760:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789181522.426134:0:15760:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789181522.426136:0:15760:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1789181522.426140:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789181522.426174:0:15760:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789181522.426179:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789181522.426186:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181522.426198:0:15760:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789181522.426202:0:15760:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9c1cc3260000) has no exports 00000020:00080000:3.0:1789181522.426238:0:15760:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9c1cc3260000) has no exports 00000020:01000000:3.0:1789181522.428058:0:15760:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c1dc4374b40 - data ffff9c1cc20a0ca8/ffff9c1dfb1a3c00 00000020:01000000:3.0:1789181522.428248:0:15760:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c1dc4374960 - data ffff9c1de4b5ea20/ffff9c1cc37c8400 00100000:10000000:0.0:1789181522.444715:0:15760:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789181522.453928:0:15760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516e7c 00000020:00000080:1.0:1789181522.454141:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1cc326c800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789181522.454164:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc326c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:1.0:1789181522.454183:0:15760:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1cc2475000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789181522.454187:0:15760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1cc2475000 2 00000020:01000004:1.0:1789181522.454190:0:15760:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c1cc2475000 from lustre-OST0001 00000020:00000080:1.0:1789181522.454215:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789181522.454234:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789181522.454237:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1cc326d000/lustre-OST0001_UUID 00000020:00000080:1.0:1789181522.454240:0:15760:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc326d000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789181522.454247:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789181522.455786:0:15760:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import da575344-f445-48a7-8532-0e6efd2ea878->MGS 00010000:00010000:1.0:1789181522.455807:0:15760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ae00/0x76fb555283516bd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb555283516bdc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181522.455823:0:15760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ae00/0x76fb555283516bd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb555283516bdc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181522.455829:0:15760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789181522.455832:0:15760:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789181522.455835:0:15760:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789181522.455853:0:15760:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1de60e2800 00010000:00010000:1.0:1789181522.455857:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc658ae00/0x76fb555283516bd5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb555283516bdc expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181522.455876:0:15760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1800/0x76fb555283517058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x76fb55528351705f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181522.455882:0:15760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1800/0x76fb555283517058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x76fb55528351705f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181522.455888:0:15760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789181522.455900:0:15760:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789181522.455902:0:15760:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789181522.455913:0:15760:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c1de60e2800 00010000:00010000:1.0:1789181522.455916:0:15760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e021f1800/0x76fb555283517058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x76fb55528351705f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789181522.455940:0:15760:0:(import.c:65:import_set_state_nolock()) ffff9c1de60e2800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789181522.455944:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789181522.455947:0:15760:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789181522.455949:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789181522.455954:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789181522.456430:0:15760:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c1cc3848000 x1876092408468608/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789181528 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789181522.456464:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789181522.456467:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:2.0:1789181522.456617:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da575344-f445-48a7-8532-0e6efd2ea878:3642:1876092408468608:0@lo:250:kworker.0 10000000:01000000:1.0:1789181522.457032:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789181522.457044:0:15760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516ad2 00000020:00000080:1.0:1789181522.457054:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1de60e0800/da575344-f445-48a7-8532-0e6efd2ea878 00000020:01000000:1.0:1789181522.457074:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.101@tcp (flags='') 00000020:00000080:1.0:1789181522.457085:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de60e0800/da575344-f445-48a7-8532-0e6efd2ea878 for MGC192.168.202.101@tcp 00000020:00000080:1.0:1789181522.457106:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181522.457115:0:15760:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.101@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789181522.457119:0:15760:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9c1dd13ecd40) has no exports 10000000:01000000:3.0:1789181522.457248:0:6518:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789181522.457411:0:15760:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.101@tcp: client import never connected 00000100:00080000:1.0:1789181522.457414:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789181522.457416:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789181522.457419:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789181522.457421:0:15760:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789181522.457445:0:1011:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1de60e2800 for MGC192.168.202.101@tcp 00000020:00000080:1.0:1789181522.457483:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789181522.457489:0:15760:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.101@tcp (uuid da575344-f445-48a7-8532-0e6efd2ea878) 00000020:00000080:1.0:1789181522.457493:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1de60e7000/da575344-f445-48a7-8532-0e6efd2ea878 00000020:00000080:1.0:1789181522.457506:0:15760:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1de60e7000/da575344-f445-48a7-8532-0e6efd2ea878 for MGC192.168.202.101@tcp 00000020:01000000:1.0:1789181522.457510:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.101@tcp (da575344-f445-48a7-8532-0e6efd2ea878) 00000020:01000000:1.0:1789181522.457827:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789181522.457831:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181522.457836:0:15760:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789181522.457842:0:15760:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c1e00843800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789181522.457847:0:15760:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff9c1e00954d40) has exports, disconnecting them 00000020:00080000:1.0:1789181522.457852:0:15760:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c1e00843800), last request at 1789181302 00000020:00000080:1.0:1789181522.457856:0:15760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516ea6 00000020:00080000:1.0:1789181522.457867:0:15760:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1e00843800): rc 0 00000020:00000080:1.0:1789181522.457870:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1e00843800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789181522.458393:0:1011:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1e00843800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789181522.466855:0:15760:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789181522.466865:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789181522.466871:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789181522.466879:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789181522.466919:0:27:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1e00841800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789181522.467138:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789181522.467150:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789181522.467156:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1e00847000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789181522.467175:0:15760:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1e00847000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789181522.467190:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1789181522.467278:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789181522.467283:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789181522.467290:0:15760:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789181522.467298:0:15760:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9c1cc326b800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789181522.467305:0:15760:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff9c1cc3263380) has exports, disconnecting them 00000020:00080000:2.0:1789181522.467310:0:15760:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9c1cc326b800), last request at 1789181302 00000020:00000080:2.0:1789181522.467314:0:15760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516ebb 00000020:00080000:2.0:1789181522.467328:0:15760:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c1cc326b800): rc 0 00000020:00000080:2.0:1789181522.467333:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1cc326b800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1789181522.467359:0:27:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc326b800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1789181522.470821:0:15760:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789181522.470834:0:15760:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789181522.470840:0:15760:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789181522.470851:0:15760:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789181522.470891:0:12865:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c1cc326c000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789181522.470961:0:13192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789181522.475838:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789181522.475887:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789181522.476160:0:6504:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c1dd1285800:6504] 1 exiting: rc = 0 00000100:00100000:0.0:1789181522.476248:0:9526:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9c1cc2469600:9526] 2 exiting: rc = 0 00000100:00100000:3.0:1789181522.476966:0:6503:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c1dd1dab600:6503] 0 exiting: rc = 1 00000100:00100000:1.0:1789181522.477095:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.477381:0:6505:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c1dd1284400:6505] 0 exiting: rc = 1 00000100:00100000:3.0:1789181522.477490:0:6506:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c1dd1285200:6506] 1 exiting: rc = 0 00000100:00100000:0.0:1789181522.477623:0:6507:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c1dd1285600:6507] 2 exiting: rc = 0 00000100:00100000:2.0:1789181522.477832:0:7462:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c1df3cdf000:7462] 3 exiting: rc = 0 00000100:00100000:1.0:1789181522.477937:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.477944:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.477950:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.477955:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.477961:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.477967:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.477972:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.477976:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.477980:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478082:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478089:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478093:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478097:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478101:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478105:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478108:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478112:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478125:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478129:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478133:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478137:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478140:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478144:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478147:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478150:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478153:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478156:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478159:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478163:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478167:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478170:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478174:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478176:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478179:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478182:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478185:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478189:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478191:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478195:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478198:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478201:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478204:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478208:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478211:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478214:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478217:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478220:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478236:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478240:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478245:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478251:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478256:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478268:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478339:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478348:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478352:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478357:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478362:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478366:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478371:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478376:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478381:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478385:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.478391:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789181522.480153:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181522.480165:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789181522.480171:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1cc326e800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789181522.480176:0:15760:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc326e800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789181522.480182:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789181522.480246:0:15760:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1cc2475000 1 00000020:00000080:0.0:1789181522.480253:0:15760:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x76fb555283516e4b 00000020:00000080:0.0:1789181522.480260:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1cc1d29000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789181522.480271:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789181522.480343:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181522.480348:0:15760:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789181522.480352:0:15760:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff9c1de7f219c0) has no exports 00000020:00000080:0.0:1789181522.485922:0:12254:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1cc1d29000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789181522.519142:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181522.519158:0:15760:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789181522.519165:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1dfaf46800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789181522.519170:0:15760:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfaf46800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789181522.519182:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789181522.519656:0:15760:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c1dd36bd000 00000020:01000000:0.0:1789181522.519686:0:15760:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789181522.519691:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181522.519704:0:15760:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789181522.519707:0:15760:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9c1e00950000) has no exports 00000020:00000080:0.0:1789181522.519965:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181522.519973:0:15760:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789181522.519976:0:15760:0:(genops.c:885:class_export_put()) final put ffff9c1dfb1da800/OSS_uuid 00000020:00000080:0.0:1789181522.520043:0:15760:0:(genops.c:844:class_export_destroy()) destroying export ffff9c1dfb1da800/OSS_uuid for OSS 00000020:01000000:0.0:1789181522.520049:0:15760:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789181522.520203:0:8437:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9c1de7e1dc00:8437] 2 exiting: rc = 0 00000100:00100000:3.0:1789181522.520307:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9c1df9ce1a00:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1789181522.520474:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9c1df9ce1800:8436] 1 exiting: rc = 0 00000100:00100000:1.0:1789181522.520522:0:8629:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9c1dfb5c4000:8629] 3 exiting: rc = 0 00000100:00080000:2.0:1789181522.520667:0:6517:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789181522.521099:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521114:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521123:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521130:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521138:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521144:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521150:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521155:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521161:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521166:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521172:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521178:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521185:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521190:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521194:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521199:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521205:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521210:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521215:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521220:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521237:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521243:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521248:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521253:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521258:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521263:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521268:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521346:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521364:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521389:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521401:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521409:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521415:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521421:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521428:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521433:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521438:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521444:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521450:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521455:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521462:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521469:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521475:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521482:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521489:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521494:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521500:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521506:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521512:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521518:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521523:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521529:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521541:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521549:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521555:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521562:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521567:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521573:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521580:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521585:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521591:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521597:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521602:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.521677:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181522.523329:0:8438:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c1df9cd0200:8438] 0 exiting: rc = 1 00000100:00100000:1.0:1789181522.523507:0:13821:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c1dd628ee00:13821] 2 exiting: rc = 0 00000100:00100000:2.0:1789181522.523684:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c1dfb0c0800:8439] 1 exiting: rc = 0 00000100:00100000:0.0:1789181522.523978:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524001:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524008:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524013:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524019:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524024:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524029:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524034:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524040:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524046:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524051:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524057:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524062:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524067:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524072:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524078:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524083:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524089:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524095:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524100:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524105:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524122:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524127:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524132:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524137:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524142:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524147:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524153:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524158:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524164:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524169:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524174:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524179:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524184:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524207:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524212:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524218:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524234:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524239:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524245:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524250:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524255:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524261:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524267:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524283:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524290:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524295:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524301:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524306:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524312:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524316:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524322:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524327:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524332:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524337:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524343:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524348:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524352:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524362:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524369:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524375:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524380:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524386:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.524390:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789181522.525700:0:8442:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c1dfb0c0e00:8442] 1 exiting: rc = 0 00000100:00100000:1.0:1789181522.526110:0:8443:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c1dfb0c1400:8443] 2 exiting: rc = 0 00000100:00100000:3.0:1789181522.530181:0:8441:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c1dd226ec00:8441] 0 exiting: rc = 1 00000100:00100000:0.0:1789181522.533963:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534004:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534013:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534019:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534025:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534049:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534056:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534062:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534068:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534074:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534079:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534085:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534091:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534098:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534104:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534110:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534116:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534122:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534128:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534135:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534140:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534148:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534154:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534159:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534164:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534170:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534191:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534198:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534204:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534210:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534215:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534229:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534236:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534241:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534247:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534252:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534258:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534263:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534269:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534410:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534425:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534431:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534438:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534443:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534449:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534456:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534463:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534468:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534474:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534480:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534502:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534509:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534515:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534521:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534527:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534533:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534540:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534545:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534551:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534562:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534576:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534591:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534599:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.534624:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789181522.543392:0:8444:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c1dfb102400:8444] 0 exiting: rc = 1 00000100:00100000:0.0:1789181522.543598:0:8445:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c1dfb5d9000:8445] 1 exiting: rc = 0 00000100:00100000:1.0:1789181522.544144:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544152:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544160:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544164:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544171:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544177:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544182:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544187:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544194:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544198:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544212:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544219:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544236:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544242:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544247:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544397:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544403:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544409:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544429:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544435:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544441:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544447:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544454:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544459:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544465:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544470:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544475:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544482:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544487:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544492:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544497:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544503:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544509:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544514:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544519:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544525:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544530:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544535:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544540:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544545:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544551:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544556:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544562:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544568:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544573:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544577:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544582:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544587:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544591:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544596:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544600:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544605:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544705:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544718:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544787:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544793:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544799:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544804:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544810:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544815:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544821:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544826:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544831:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.544837:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181522.546956:0:8446:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c1dfb0b5800:8446] 0 exiting: rc = 1 00000100:00100000:3.0:1789181522.547489:0:8447:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c1dfb5d9800:8447] 1 exiting: rc = 0 00000100:00100000:1.0:1789181522.547601:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547620:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547627:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547634:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547640:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547645:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547651:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547679:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547686:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547693:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547699:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547705:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547712:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547719:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547901:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547909:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547915:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547921:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547928:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547952:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547961:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547968:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.547974:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548055:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548076:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548081:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548088:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548094:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548102:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548107:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548114:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548136:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548144:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548151:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548159:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548166:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548172:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548178:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548186:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548193:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548199:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548205:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548211:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548244:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548254:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548259:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548266:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548344:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548354:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548360:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548367:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548375:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548382:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548387:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548393:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548415:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548423:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548428:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548434:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548449:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548464:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548480:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548488:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181522.548500:0:15760:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789181522.566405:0:15760:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789181545.378605:0:16524:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789181558.128483:0:17124:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789181558.128489:0:17124:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789181558.128490:0:17124:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789181558.128599:0:17124:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c1cc44fb800 00000020:01000004:2.0:1789181558.128617:0:17124:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789181558.128626:0:17124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789181558.128641:0:17124:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c1de7f24d40) 00000020:00000080:2.0:1789181558.128667:0:17124:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789181558.226478:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789181558.228863:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789181558.230356:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789181558.230621:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789181558.231176:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789181558.231580:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789181558.231962:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789181558.232207:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789181558.232405:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789181558.233291:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789181558.233538:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789181558.234071:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789181558.234258:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789181558.234438:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789181558.235828:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789181558.237548:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.238096:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.238294:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.238536:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.238902:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.239132:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.239512:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.239871:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.240113:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.240328:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.240541:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.240953:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.241537:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.242036:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.242264:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.242451:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.242948:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.243147:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.243343:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.243586:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.243884:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.244118:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.244336:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.244562:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.244858:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.245099:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.245319:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.245887:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.246120:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.246320:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.246480:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789181558.246638:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789181558.248045:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789181558.248449:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789181558.249003:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789181558.249421:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789181558.249642:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789181558.250114:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1789181558.251082:0:17124:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789181558.251286:0:17124:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789181558.251294:0:17124:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789181558.251307:0:17124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283518081 00000020:01000004:2.0:1789181558.251314:0:17124:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789181558.251319:0:17124:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789181558.251324:0:17124:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c1cc44fb800 from MGS 00000020:01000004:2.0:1789181558.251328:0:17124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789181558.251338:0:17124:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c1de7f219c0) 00000020:00000080:2.0:1789181558.251350:0:17124:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789181558.251411:0:17124:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1cc44fb800 from MGS, refs=2 00080000:01000000:2.0:1789181558.251416:0:17124:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789181558.251421:0:17124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb55528351808f 00000100:00100000:2.0:1789181558.251523:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789181558.251647:0:17124:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789181558.251672:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789181558.252197:0:17124:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789181558.252206:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789181558.253197:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181558.253362:0:17124:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789181558.253368:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789181558.254233:0:17124:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789181558.254243:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789181558.254535:0:17124:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789181558.254542:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789181558.255389:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181558.255392:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181558.255394:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181558.259420:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181558.259428:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181558.259431:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181558.260770:0:17124:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789181558.262055:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789181558.269402:0:17124:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789181558.272939:0:17136:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789181558.273013:0:17124:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789181558.273066:0:17124:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789181558.273640:0:17124:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789181558.273987:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789181558.274153:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789181558.274159:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789181558.277663:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789181558.277681:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789181558.278247:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789181558.278256:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789181558.279612:0:17124:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789181558.279637:0:17124:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:0.0:1789181558.279639:0:17124:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1789181558.279795:0:17141:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:0.0:1789181558.279974:0:17124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:0.0:1789181558.279988:0:17124:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (ffff9c1dfaf48000) 00000020:00000080:0.0:1789181558.280006:0:17124:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789181558.280091:0:17124:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1dd00d3000@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1789181558.280245:0:17124:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:0.0:1789181558.280252:0:17124:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789181558.280666:0:17142:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789181558.280762:0:17124:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid 868df35c-3970-416b-9e25-2e3d68c8633a) 00000020:00000080:2.0:1789181558.280779:0:17124:0:(genops.c:1384:class_connect()) connect: client 868df35c-3970-416b-9e25-2e3d68c8633a, cookie 0x76fb55528351809d 00000100:00080000:2.0:1789181558.280790:0:17124:0:(import.c:545:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789181558.280798:0:17124:0:(import.c:666:import_select_connection()) MGC192.168.202.101@tcp: import ffff9c1dd00d3000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1789181558.280844:0:17124:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dff850380 x1876092408469376/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789181558.280868:0:17124:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import 868df35c-3970-416b-9e25-2e3d68c8633a->MGS 00000020:01000004:2.0:1789181558.280886:0:17124:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789181558.280919:0:17124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789181558.280931:0:17124:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c1de7f20000) 00000020:00000080:2.0:1789181558.280940:0:17124:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789181558.281082:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:868df35c-3970-416b-9e25-2e3d68c8633a:3642:1876092408469376:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789181558.281158:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181558.281247:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408469376 00000100:00100000:0.0:1789181558.281257:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408469376 00000100:00100000:0.0:1789181558.281288:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181558.281294:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1876092408469376:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789181558.281317:0:17138:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 868df35c-3970-416b-9e25-2e3d68c8633a@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:0.0:1789181558.281340:0:17138:0:(genops.c:1384:class_connect()) connect: client 868df35c-3970-416b-9e25-2e3d68c8633a, cookie 0x76fb5552835180ab 00000100:00080000:0.0:1789181558.281453:0:17138:0:(import.c:65:import_set_state_nolock()) ffff9c1dd00d0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181558.281508:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+5:3642:x1876092408469376:12345-0@lo:250:mount.lustre.0 Request processed in 213us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181558.281517:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181558.281562:0:3642:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789181558.281572:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.101@tcp: connect to target with instance 0 00000100:00080000:0.0:1789181558.281588:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789181558.281592:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789181558.281596:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1dd00d3000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789181558.281598:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789181558.281605:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789181558.281611:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:868df35c-3970-416b-9e25-2e3d68c8633a:3642:1876092408469376:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789181558.299865:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181558.303186:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789181558.303194:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789181558.304303:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789181558.304315:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789181558.304995:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789181558.305004:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789181558.306498:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181558.306659:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789181558.306666:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789181558.313687:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789181558.313703:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789181558.383266:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789181558.383713:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789181558.383752:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789181558.385030:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789181558.385040:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789181558.385662:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181558.386168:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789181558.386174:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789181558.386692:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789181558.386700:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789181558.387393:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789181558.387621:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789181558.387626:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789181558.392913:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789181558.393156:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789181558.393863:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789181558.394296:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789181558.394302:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789181558.396707:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789181558.396946:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789181558.421140:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181558.421368:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789181558.421375:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789181558.422983:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789181558.422995:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789181558.424044:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789181558.424055:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789181558.425055:0:17124:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789181558.425088:0:17124:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789181558.425095:0:17124:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789181558.425216:0:17124:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789181558.425256:0:17124:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789181558.425262:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789181558.425264:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789181558.425266:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181558.425267:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181558.425267:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181558.425269:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181558.425270:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789181558.425271:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789181558.425273:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181558.425274:0:17124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789181558.425277:0:17124:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789181558.425279:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789181558.425280:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789181558.425281:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181558.425282:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181558.425283:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181558.425285:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181558.425285:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789181558.425286:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789181558.425287:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181558.425293:0:17124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789181558.425324:0:17124:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789181558.425347:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408469504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789181558.425422:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181558.425516:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408469504 00000100:00100000:0.0:1789181558.425524:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408469504 00000100:00100000:1.0:1789181558.425540:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3e35a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181558.425571:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181558.425580:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+5:17124:x1876092408469504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789181558.425626:0:17140:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789181558.425628:0:17140:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789181558.425630:0:17140:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789181558.426205:0:17161:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789181558.426545:0:17140:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789181558.431389:0:17162:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789181558.431397:0:17162:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789181558.431400:0:17162:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789181558.431402:0:17162:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789181558.431582:0:17162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789181558.433217:0:17140:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789181558.433234:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789181558.439248:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+5:17124:x1876092408469504:12345-0@lo:253:mount.lustre.0 Request processed in 13659us (13817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181558.439265:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181558.439393:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408469504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789181558.439410:0:17124:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789181558.439414:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789181558.439415:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789181558.439417:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181558.439419:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181558.439420:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181558.439421:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181558.439423:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789181558.439424:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789181558.439426:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181558.439427:0:17124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789181558.439448:0:17124:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c1cc44fb800 from lustre-MDT0000 10000000:01000000:3.0:1789181558.439483:0:17124:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789181558.439487:0:17124:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789181558.439492:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c1dfaf48000 10000000:01000000:3.0:1789181558.439496:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789181558.439505:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c1dfaf48000 from 1 10000000:01000000:3.0:1789181558.439509:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789181558.439550:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.439579:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.439590:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181558.439609:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408469632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181558.439661:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181558.439698:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd0039480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181558.439872:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408469632 00000100:00100000:2.0:1789181558.439879:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408469632 00000100:00100000:2.0:1789181558.439927:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181558.439936:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+5:17124:x1876092408469632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181558.439949:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181558.439964:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0084b400/0x76fb5552835180b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835180b2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.439985:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0084b400/0x76fb5552835180b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835180b2 expref: 6 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.439996:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0084b400/0x76fb5552835180b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835180b2 expref: 6 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.440004:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b400, rc 0) 00000100:00100000:2.0:1789181558.440041:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+6:17124:x1876092408469632:12345-0@lo:101:mount.lustre.0 Request processed in 107us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181558.440047:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181558.440128:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408469632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181558.440141:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.440150:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181558.440213:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408469760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181558.440237:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181558.440254:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd0039480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181558.440310:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408469760 00000100:00100000:0.0:1789181558.440314:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408469760 00000100:00100000:0.0:1789181558.440340:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181558.440352:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+6:17124:x1876092408469760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181558.440423:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+6:17124:x1876092408469760:12345-0@lo:501:mount.lustre.0 Request processed in 72us (185us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789181558.440429:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181558.440499:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408469760:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789181558.440524:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789181558.440540:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.440549:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181558.440568:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c1cc44fb800 10000000:01000000:3.0:1789181558.440572:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789181558.440575:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c1cc44fb800 10000000:01000000:3.0:1789181558.440577:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789181558.440580:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c1cc44fb800 from 1 10000000:01000000:3.0:1789181558.440582:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789181558.440595:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f600/0x76fb5552835180c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.440602:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f600/0x76fb5552835180c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.440610:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f600/0x76fb5552835180c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181558.440620:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408469888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181558.440642:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181558.440663:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd0039480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181558.440912:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408469888 00000100:00100000:0.0:1789181558.440917:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408469888 00000100:00100000:0.0:1789181558.440940:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181558.440946:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+6:17124:x1876092408469888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181558.440952:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181558.440963:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f0200/0x76fb5552835180c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835180c0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.440976:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f0200/0x76fb5552835180c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835180c0 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.440985:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f0200/0x76fb5552835180c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835180c0 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.440991:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0200, rc 0) 00000100:00100000:0.0:1789181558.441026:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+7:17124:x1876092408469888:12345-0@lo:101:mount.lustre.0 Request processed in 80us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181558.441032:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181558.441106:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408469888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181558.441117:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f600/0x76fb5552835180c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.441124:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f600/0x76fb5552835180c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835180c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181558.441134:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789181558.441148:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f600/0x76fb5552835180c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.441161:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f600/0x76fb5552835180c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181558.441167:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789181558.441170:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789181558.441174:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c1cc44fb800 10000000:01000000:3.0:1789181558.441176:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789181558.441178:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789181558.441181:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789181558.441194:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ea00/0x76fb5552835180ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.441201:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ea00/0x76fb5552835180ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.441207:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ea00/0x76fb5552835180ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181558.441219:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408470016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181558.441243:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181558.441259:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd0039480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181558.441312:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408470016 00000100:00100000:2.0:1789181558.441316:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408470016 00000100:00100000:2.0:1789181558.441343:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181558.441349:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+7:17124:x1876092408470016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181558.441361:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181558.441368:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0084be00/0x76fb5552835180d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835180ce expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.441380:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0084be00/0x76fb5552835180d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835180ce expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.441388:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0084be00/0x76fb5552835180d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835180ce expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.441395:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084be00, rc 0) 00000100:00100000:2.0:1789181558.441418:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+8:17124:x1876092408470016:12345-0@lo:101:mount.lustre.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181558.441423:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181558.441492:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408470016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181558.441502:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ea00/0x76fb5552835180ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180d5 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.441509:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ea00/0x76fb5552835180ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835180d5 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181558.441560:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408470144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181558.441583:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181558.441600:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd0039480 going to sleep for 11 seconds 00000100:00100000:3.0:1789181558.441615:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408470144 00000100:00100000:3.0:1789181558.441618:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408470144 00000100:00100000:3.0:1789181558.441645:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181558.441657:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+8:17124:x1876092408470144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181558.441913:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+9:17124:x1876092408470144:12345-0@lo:501:mount.lustre.0 Request processed in 261us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181558.441920:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181558.441953:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408470144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181558.441979:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408470272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181558.442019:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181558.442033:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd0039480 going to sleep for 11 seconds 00000100:00100000:3.0:1789181558.442045:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408470272 00000100:00100000:3.0:1789181558.442049:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408470272 00000100:00100000:3.0:1789181558.442065:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181558.442070:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+9:17124:x1876092408470272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181558.444028:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+9:17124:x1876092408470272:12345-0@lo:503:mount.lustre.0 Request processed in 1949us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181558.444043:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789181558.448308:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4472300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408470272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181558.449105:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17163:1876092408470400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181558.449192:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181558.449239:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd9398c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181558.449301:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408470400 00000100:00100000:2.0:1789181558.449308:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408470400 00000100:00100000:2.0:1789181558.449362:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789181558.449373:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+9:17163:x1876092408470400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181558.450311:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+9:17163:x1876092408470400:12345-0@lo:502:llog_process_th.0 Request processed in 935us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181558.450322:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181558.450416:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17163:1876092408470400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789181558.450445:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181558.450457:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181558.450459:0:17163:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789181558.450464:0:17163:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789181558.450466:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789181558.450482:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c1cc38e8000) 00000020:00000080:1.0:1789181558.450501:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789181558.450507:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789181558.450593:0:17163:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789181558.450601:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb5552835180e3 00000020:00000080:1.0:1789181558.451044:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789181558.451049:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181558.451054:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181558.451055:0:17163:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789181558.451058:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181558.451061:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181558.451069:0:17163:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789181558.451073:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789181558.451081:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c1cc38eb380) 00000020:00000080:1.0:1789181558.451092:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789181558.451096:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789181558.451098:0:17163:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789181558.451101:0:17163:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789181558.451107:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789181558.451156:0:17163:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1cc44fb800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789181558.451171:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c1cc38e99c0) 00000020:00000080:1.0:1789181558.451179:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789181558.451235:0:17163:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789181558.451241:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb5552835180f8 00000020:00000080:1.0:1789181558.451329:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789181558.451335:0:17163:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789181558.451339:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x76fb5552835180ff 00080000:01000000:1.0:1789181558.451344:0:17163:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789181558.451348:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283518106 00010000:00010000:2.0:1789181558.569247:0:17163:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789181558.569953:0:17163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1789181558.570447:0:17163:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789181558.571166:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c1de7f23380) 00000020:00000080:2.0:1789181558.571193:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789181558.571277:0:17163:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789181558.571285:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283518114 00000020:00000080:2.0:1789181558.572036:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789181558.581143:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x76fb55528351811b 00000020:00000080:2.0:1789181558.582297:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789181558.582308:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181558.582315:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.582317:0:17163:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789181558.582320:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789181558.582323:0:17163:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1789181558.582325:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789181558.582326:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789181558.582328:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789181558.582331:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.582332:0:17163:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789181558.582335:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181558.582339:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.582340:0:17163:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789181558.582345:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789181558.582387:0:17163:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789181558.582401:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181558.582404:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.582406:0:17163:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789181558.582408:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181558.582411:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.582412:0:17163:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789181558.582415:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789181558.582421:0:17163:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:00000080:2.0:1789181558.582445:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789181558.582461:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c1dd13ecd40) 00000020:00000080:2.0:1789181558.582478:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789181558.582483:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789181558.582533:0:17163:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789181558.582538:0:17163:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789181558.582544:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283518129 00010000:00080000:2.0:1789181558.582583:0:17163:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1dfaf22000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1789181558.584235:0:17163:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789181558.585747:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789181558.585763:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789181558.585797:0:17163:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789181558.585821:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb555283518130 00000100:00080000:2.0:1789181558.585833:0:17163:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789181558.585845:0:17163:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c1dfaf22000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1789181558.585885:0:17163:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dff851180 x1876092408470528/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789181558.585922:0:17163:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1789181558.585990:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181558.585995:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.585996:0:17163:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789181558.585999:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789181558.586003:0:17163:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1789181558.586004:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789181558.586006:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789181558.586008:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789181558.586010:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.586011:0:17163:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789181558.586014:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789181558.586018:0:17163:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789181558.586021:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.586023:0:17163:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789181558.586026:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789181558.586029:0:17163:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1789181558.586052:0:17163:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789181558.586055:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789181558.586069:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c1dd13e8000) 00000020:00000080:2.0:1789181558.586081:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789181558.586096:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789181558.586150:0:17163:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789181558.586156:0:17163:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789181558.586161:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb55528351813e 00010000:00080000:2.0:1789181558.586188:0:17163:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1de7f49000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1789181558.586375:0:17163:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1789181558.586939:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408470528:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789181558.587027:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181558.587165:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408470528 00000100:00100000:1.0:1789181558.587174:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408470528 00000100:00100000:1.0:1789181558.587210:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181558.587218:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876092408470528:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1789181558.587234:0:17150:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1789181558.591673:0:17163:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789181558.592175:0:17163:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789181558.593989:0:17163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789181558.594223:0:17163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789181558.601220:0:17163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:1.0:1789181558.605754:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876092408470528:12345-0@lo:38:llog_process_th.0 Request processed in 18505us (18699us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789181558.605769:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789181558.605821:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf22000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789181558.605826:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789181558.605831:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408470528:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789181558.607135:0:17169:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789181558.607143:0:17169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789181558.608104:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789181558.608116:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789181558.608154:0:17163:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789181558.608179:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb555283518145 00000100:00080000:2.0:1789181558.608193:0:17163:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789181558.608208:0:17163:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c1de7f49000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1789181558.608252:0:17163:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dff850700 x1876092408470656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789181558.608281:0:17163:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789181558.608331:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181558.608336:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.608338:0:17163:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000100:00100000:0.0:1789181558.608439:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408470656:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789181558.608506:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092408470656 offset 0 length 520: 4 00000020:01000000:2.0:1789181558.608590:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789181558.608593:0:17163:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789181558.608595:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789181558.608597:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789181558.608598:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789181558.608602:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.608608:0:17163:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789181558.608612:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789181558.608616:0:17163:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789181558.608619:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.608621:0:17163:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789181558.608624:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789181558.608627:0:17163:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1789181558.608648:0:17163:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789181558.608661:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789181558.608674:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c1dd13eb380) 00000020:00000080:2.0:1789181558.608687:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789181558.608693:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789181558.609001:0:17163:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789181558.609008:0:17163:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789181558.609014:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x76fb555283518153 00010000:00080000:3.0:1789181558.609057:0:17163:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1cc1d28000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1789181558.609269:0:17163:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789181558.609336:0:17163:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789181558.609430:0:17163:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789181558.611247:0:17163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181558.611924:0:17163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789181558.612108:0:17163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789181558.613394:0:17171:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789181558.613402:0:17171:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789181558.614897:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789181558.615038:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789181558.615102:0:17163:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789181558.615129:0:17163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb55528351815a 00000100:00080000:2.0:1789181558.615141:0:17163:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789181558.615155:0:17163:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c1cc1d28000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1789181558.615199:0:17163:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dff853100 x1876092408470784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789181558.615267:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408470784:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789181558.615323:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092408470784 offset 0 length 520: 4 00000100:00080000:2.0:1789181558.615395:0:17163:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789181558.615459:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181558.615464:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.615466:0:17163:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789181558.615469:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181558.615473:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.615475:0:17163:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789181558.615478:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789181558.615480:0:17163:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789181558.615482:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181558.615491:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.615492:0:17163:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789181558.615495:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181558.615498:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.615499:0:17163:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789181558.615503:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789181558.615531:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17163:1876092408470912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181558.615580:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181558.615614:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f87180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181558.615942:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408470912 00000100:00100000:3.0:1789181558.615951:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408470912 00000100:00100000:3.0:1789181558.615998:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181558.616008:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+9:17163:x1876092408470912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181558.616145:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+9:17163:x1876092408470912:12345-0@lo:502:llog_process_th.0 Request processed in 138us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181558.616153:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789181558.616339:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17163:1876092408470912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181558.616378:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181558.616385:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181558.616387:0:17163:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789181558.616390:0:17163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789181558.616628:0:17124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789181558.616664:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789181558.616685:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ea00/0x76fb5552835180ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180d5 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.616697:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ea00/0x76fb5552835180ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180d5 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181558.616706:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1cc44fb800 from 1 10000000:01000000:3.0:1789181558.616709:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789181558.616769:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.616777:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.616787:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181558.616815:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181558.616854:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181558.616882:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc8ef2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181558.617292:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408471040 00000100:00100000:0.0:1789181558.617299:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408471040 00000100:00100000:0.0:1789181558.617352:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181558.617360:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+9:17124:x1876092408471040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181558.617372:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181558.617386:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f1e00/0x76fb555283518168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283518161 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.617411:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f1e00/0x76fb555283518168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283518161 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.617421:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f1e00/0x76fb555283518168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518161 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.617430:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1e00, rc 0) 00000100:00100000:0.0:1789181558.617480:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+10:17124:x1876092408471040:12345-0@lo:101:mount.lustre.0 Request processed in 120us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181558.617486:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789181558.617677:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181558.617692:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.617702:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181558.618285:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471168:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789181558.618338:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181558.618383:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f87180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181558.618406:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408471168 00000100:00100000:2.0:1789181558.618412:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408471168 00000100:00100000:2.0:1789181558.618447:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181558.618455:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+10:17124:x1876092408471168:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789181558.618514:0:17139:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789181558.618520:0:17139:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789181558.618582:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+10:17124:x1876092408471168:12345-0@lo:256:mount.lustre.0 Request processed in 127us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181558.618974:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181558.619020:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471168:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789181558.619996:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789181558.620076:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.620089:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181558.620096:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1cc44fb800 from 1 10000000:01000000:2.0:1789181558.620099:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181558.620133:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.620141:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.620150:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181558.620170:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789181558.620222:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181558.620254:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f87180 going to sleep for 11 seconds 00000100:00100000:0.0:1789181558.620429:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408471296 00000100:00100000:0.0:1789181558.620436:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408471296 00000100:00100000:0.0:1789181558.620518:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181558.620528:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+10:17124:x1876092408471296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181558.620552:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181558.620565:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f1000/0x76fb555283518176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351816f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.620598:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f1000/0x76fb555283518176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351816f expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.620609:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f1000/0x76fb555283518176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351816f expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.620618:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1000, rc 0) 00000100:00100000:0.0:1789181558.620801:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+11:17124:x1876092408471296:12345-0@lo:101:mount.lustre.0 Request processed in 274us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181558.620809:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181558.621172:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181558.621189:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.621199:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181558.621266:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181558.621300:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181558.621334:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc8ef2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181558.621463:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408471424 00000100:00100000:0.0:1789181558.621469:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408471424 00000100:00100000:0.0:1789181558.621494:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181558.621501:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+11:17124:x1876092408471424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181558.621660:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+11:17124:x1876092408471424:12345-0@lo:501:mount.lustre.0 Request processed in 159us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181558.621668:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181558.622256:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181558.622305:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181558.622434:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181558.622508:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd9398b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181558.622550:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408471552 00000100:00100000:0.0:1789181558.622556:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408471552 00000100:00100000:0.0:1789181558.622756:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789181558.622766:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+11:17124:x1876092408471552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789181558.622931:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+11:17124:x1876092408471552:12345-0@lo:503:mount.lustre.0 Request processed in 166us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181558.622948:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181558.623132:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181558.623517:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17173:1876092408471680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181558.623555:0:17173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181558.623716:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3e35a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181558.623842:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408471680 00000100:00100000:2.0:1789181558.623852:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408471680 00000100:00100000:2.0:1789181558.623995:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789181558.624004:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+11:17173:x1876092408471680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181558.624460:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+11:17173:x1876092408471680:12345-0@lo:502:llog_process_th.0 Request processed in 457us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181558.624469:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789181558.624543:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17173:1876092408471680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181558.624567:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181558.624576:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181558.624578:0:17173:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789181558.624595:0:17173:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1cc44fb800 00000020:00000080:0.0:1789181558.624598:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789181558.624607:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181558.624609:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181558.624611:0:17173:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789181558.624613:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181558.624615:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181558.624617:0:17173:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789181558.624620:0:17173:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1cc44fb800 00000020:00000080:0.0:1789181558.624622:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789181558.624851:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181558.624856:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181558.624858:0:17173:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789181558.624860:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181558.624863:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181558.624864:0:17173:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789181558.624867:0:17173:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1cc44fb800 00000020:00000080:0.0:1789181558.624869:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789181558.624886:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181558.624888:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181558.624898:0:17173:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789181558.624901:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181558.624903:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181558.624905:0:17173:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789181558.624908:0:17173:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1cc44fb800 00000020:00000080:0.0:1789181558.624910:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789181558.624964:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17173:1876092408471808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181558.625005:0:17173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181558.631560:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408471808 00000100:00100000:3.0:1789181558.631575:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408471808 00000100:00100000:3.0:1789181558.631634:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789181558.631644:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+11:17173:x1876092408471808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181558.632077:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+11:17173:x1876092408471808:12345-0@lo:502:llog_process_th.0 Request processed in 432us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181558.632085:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789181558.638906:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789181558.638961:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17173:1876092408471808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181558.639013:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181558.639024:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181558.639026:0:17173:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789181558.639031:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789181558.648446:0:17124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789181558.648542:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181558.648873:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.648888:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181558.648961:0:17124:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789181558.648964:0:17124:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c1cc44fb800 10000000:01000000:2.0:1789181558.648967:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c1cc44fb800 10000000:01000000:2.0:1789181558.648971:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789181558.648977:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1cc44fb800 from 1 10000000:01000000:2.0:1789181558.648980:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789181558.649019:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a600/0x76fb55528351817d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.649029:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a600/0x76fb55528351817d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.649040:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a600/0x76fb55528351817d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181558.649065:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789181558.649143:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181558.649182:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f87b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181558.649286:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408471936 00000100:00100000:3.0:1789181558.649294:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408471936 00000100:00100000:3.0:1789181558.649423:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789181558.649433:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+11:17124:x1876092408471936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181558.649445:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181558.649520:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085f800/0x76fb555283518184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351817d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.649547:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085f800/0x76fb555283518184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351817d expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.649557:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085f800/0x76fb555283518184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351817d expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181558.649566:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085f800, rc 0) 00000100:00100000:3.0:1789181558.649765:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17124:x1876092408471936:12345-0@lo:101:mount.lustre.0 Request processed in 332us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181558.649773:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789181558.650580:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408471936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181558.650615:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a600/0x76fb55528351817d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518184 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.650626:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a600/0x76fb55528351817d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518184 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181558.651823:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408472064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181558.651902:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181558.651956:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f87b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181558.652041:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408472064 00000100:00100000:0.0:1789181558.652048:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408472064 00000100:00100000:0.0:1789181558.652105:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181558.652114:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:17124:x1876092408472064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181558.652244:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:17124:x1876092408472064:12345-0@lo:501:mount.lustre.0 Request processed in 130us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181558.652252:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789181558.652750:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408472064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181558.652791:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408472192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789181558.652846:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181558.652870:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f87b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181558.652887:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408472192 00000100:00100000:2.0:1789181558.652902:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408472192 00000100:00100000:2.0:1789181558.652934:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789181558.652941:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:17124:x1876092408472192:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789181558.653033:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:17124:x1876092408472192:12345-0@lo:503:mount.lustre.0 Request processed in 92us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181558.653040:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789181558.653085:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408472192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181558.665613:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17178:1876092408472320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181558.665922:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181558.667120:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181558.670040:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408472320 00000100:00100000:2.0:1789181558.670068:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408472320 00000100:00100000:2.0:1789181558.670187:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789181558.670198:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17178:x1876092408472320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181558.670390:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17178:x1876092408472320:12345-0@lo:502:llog_process_th.0 Request processed in 192us (4471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181558.670398:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181558.673851:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17178:1876092408472320:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789181558.674105:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789181558.674122:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c1cc38ecd40) 00000020:00000080:1.0:1789181558.674145:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789181558.674246:0:17178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1cc44fb800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789181558.674251:0:17178:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1cc44fb800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789181558.674254:0:17178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1cc44fb800 4 00010000:00080000:1.0:1789181558.674299:0:17178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1de7ec7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1789181558.678255:0:17178:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789181558.678931:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789181558.678976:0:17178:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789181558.678993:0:17178:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x76fb555283518192 00000100:00080000:1.0:1789181558.679005:0:17178:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181558.679017:0:17178:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c1de7ec7800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181558.679058:0:17178:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f04e00 x1876092408472448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789181558.679088:0:17178:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789181558.679262:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876092408472448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789181558.679343:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181558.679459:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408472448 00000100:00100000:2.0:1789181558.679471:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408472448 00000100:00100000:2.0:1789181558.679515:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181558.679525:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876092408472448:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789181558.679588:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1876092408472448:12345-0@lo:38:llog_process_th.0 Request processed in 63us (245us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789181558.679596:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181558.679635:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789181558.679647:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7ec7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789181558.680775:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789181558.680781:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876092408472448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789181558.681215:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17178:1876092408472576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181558.681286:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181558.681319:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f87180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181558.681338:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408472576 00000100:00100000:2.0:1789181558.681344:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408472576 00000100:00100000:2.0:1789181558.681388:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789181558.681396:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:17178:x1876092408472576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181558.681529:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:17178:x1876092408472576:12345-0@lo:502:llog_process_th.0 Request processed in 132us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181558.681538:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789181558.681589:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17178:1876092408472576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181558.681625:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17178:1876092408472704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181558.681761:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181558.681775:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f87180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181558.681789:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408472704 00000100:00100000:2.0:1789181558.681792:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408472704 00000100:00100000:2.0:1789181558.681815:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789181558.681822:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17178:x1876092408472704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181558.681882:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17178:x1876092408472704:12345-0@lo:502:llog_process_th.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181558.681899:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789181558.681939:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:868df35c-3970-416b-9e25-2e3d68c8633a:17178:1876092408472704:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789181558.681958:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789181558.682097:0:17124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789181558.682122:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181558.682139:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a600/0x76fb55528351817d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518184 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181558.682150:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0084a600/0x76fb55528351817d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518184 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789181558.682205:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789181558.682211:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789181558.682212:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181558.682214:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181558.682214:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181558.682216:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181558.682217:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181558.682218:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789181558.682220:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181558.682221:0:17124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181558.682225:0:17124:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789181558.682227:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181558.682228:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789181558.682229:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181558.682230:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181558.682231:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181558.682232:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181558.682233:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181558.682234:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789181558.682235:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181558.682236:0:17124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181558.682249:0:17124:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789181558.682258:0:17124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408472832:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789181558.682291:0:17124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181558.682312:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408472832 00000100:00100000:2.0:1789181558.682315:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408472832 00000100:00100000:2.0:1789181558.682335:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181558.682341:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17124:x1876092408472832:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789181558.682361:0:17140:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789181558.682374:0:17140:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789181558.687688:0:17124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6cfa180 going to sleep for 11 seconds 20000000:01000000:2.0:1789181558.691884:0:17140:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789181558.691930:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789181558.693876:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17124:x1876092408472832:12345-0@lo:253:mount.lustre.0 Request processed in 11525us (11574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181558.693902:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181558.693990:0:17124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17124:1876092408472832:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789181558.694007:0:17124:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789181558.694012:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789181558.694014:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789181558.694016:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181558.694017:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181558.694018:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181558.694020:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181558.694021:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181558.694023:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789181558.694025:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181558.694027:0:17124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789181558.694040:0:17124:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789181558.694765:0:17161:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789181558.694781:0:17161:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789181558.694806:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181558.694822:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1cc39f1e00/0x76fb555283518168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518161 expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181558.694831:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181558.694871:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1cc39f1e00/0x76fb555283518168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283518161 expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181558.694905:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1cc39f1e00/0x76fb555283518168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283518161 expref: 11 pid: 17138 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181558.694919:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408472960:0@lo:104: 00000100:00100000:1.0:1789181558.694965:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181558.695005:0:17161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7210900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181558.695044:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408472960 00000100:00100000:1.0:1789181558.695051:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408472960 00000100:00100000:1.0:1789181558.695100:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181558.695109:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+3:17161:x1876092408472960:12345-0@lo:104: 00010000:00010000:1.0:1789181558.695122:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181558.695170:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789181558.695176:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+3:17161:x1876092408472960:12345-0@lo:104: Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181558.695183:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181558.695220:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408472960:0@lo:104: 00010000:00010000:1.0:1789181558.695234:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.695948:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181558.695956:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.695966:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fe00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:0.0:1789181558.695970:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.695979:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181558.695987:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181558.696003:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181558.696040:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696047:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181558.696066:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696074:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518168 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696091:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181558.696093:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181558.696095:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181558.696126:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:868df35c-3970-416b-9e25-2e3d68c8633a:3644:1876092408473088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181558.696173:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181558.696247:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408473088 00000100:00100000:0.0:1789181558.696252:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408473088 00010000:00010000:0.0:1789181558.696273:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1cc39f1e00/0x76fb555283518168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283518161 expref: 12 pid: 17138 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181558.696295:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181558.696303:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:868df35c-3970-416b-9e25-2e3d68c8633a+12:3644:x1876092408473088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181558.696314:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181558.696318:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1cc39f1e00/0x76fb555283518168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283518161 expref: 12 pid: 17138 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696329:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1cc39f1e00/0x76fb555283518168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283518161 expref: 12 pid: 17138 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696349:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1cc39f1e00/0x76fb555283518168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283518161 expref: 12 pid: 17138 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696363:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696372:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789181558.696385:0:17130:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001605088s 00010000:00010000:0.0:1789181558.696390:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696398:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696405:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696412:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696418:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13e00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181558.696424:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696432:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696447:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696462:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181558.696492:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:868df35c-3970-416b-9e25-2e3d68c8633a+11:3644:x1876092408473088:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181558.696500:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181558.696534:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:868df35c-3970-416b-9e25-2e3d68c8633a:3644:1876092408473088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181558.696553:0:17161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696562:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181558.696570:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1de0b13e00/0x76fb555283518199 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789181558.712490:0:17124:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789181558.712928:0:17124:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789181558.713260:0:17185:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789181558.713448:0:17124:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1789181558.713824:0:17185:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1789181558.715986:0:17186:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c1cc3849500 x1876092408473216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181558.716000:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00000040:01000000:2.0:1789181558.716376:0:17124:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789181558.716414:0:17124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789181558.717048:0:17124:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789181558.717059:0:17124:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789181558.717100:0:17124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181558.718322:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789181558.718399:0:17185:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:1.0:1789181558.718818:0:17184:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789181558.718824:0:17184:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1789181558.719266:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789181558.720087:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789181558.720136:0:17124:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789181558.721551:0:17124:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1789181558.724345:0:17124:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789181558.727241:0:17124:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789181558.727284:0:17124:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9454191f988 00100000:10000000:3.0:1789181558.727292:0:17124:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789181558.728346:0:17124:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789181558.728363:0:17124:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789181558.728379:0:17124:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789181558.728398:0:17124:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789181558.745839:0:17124:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789181558.746103:0:17124:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789181559.309299:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181559.694839:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789181559.755872:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 10000000:01000000:3.0:1789181559.962523:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789181559.962533:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1cc44fb800 from 7 10000000:01000000:3.0:1789181559.962538:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789181559.962600:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181559.962626:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181559.964171:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181559.964218:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408473344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789181559.964305:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181559.964361:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408473344 00000100:00100000:3.0:1789181559.964364:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd22c6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181559.964370:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408473344 00000100:00100000:2.0:1789181559.964446:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789181559.964457:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+11:17142:x1876092408473344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181559.964475:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181559.964495:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0084b200/0x76fb5552835181a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835181a0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181559.964539:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0084b200/0x76fb5552835181a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835181a0 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181559.964550:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0084b200/0x76fb5552835181a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835181a0 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181559.964559:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b200, rc 0) 00000100:00100000:2.0:1789181559.964610:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+12:17142:x1876092408473344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181559.964618:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789181559.964846:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408473344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181559.964864:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181559.964873:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181559.964943:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408473472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789181559.964980:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181559.965247:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408473472 00000100:00100000:2.0:1789181559.965253:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408473472 00000100:00100000:2.0:1789181559.965289:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181559.965297:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17142:x1876092408473472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789181559.965313:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789181559.965333:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789181559.965336:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789181559.965421:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17142:x1876092408473472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181559.965428:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789181559.965527:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd22c6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181559.965543:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408473472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789181559.965587:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789181559.965594:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181559.965605:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181560.333379:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181560.720322:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789181560.780266:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:0.0:1789181561.356083:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181561.803852:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:1.0:1789181562.380450:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181562.831031:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00000001:02000400:2.0:1789181563.092001:0:17428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789181563.404005:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181563.858556:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00000100:00080000:1.0:1789181564.178418:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789181564.178426:0:126:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789181564.178430:0:126:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf22000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181564.178439:0:126:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:1.0:1789181564.178445:0:126:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789181564.178457:0:126:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c1dfaf22000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181564.178484:0:126:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f05880 x1876092408473728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789181564.178501:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181564.178505:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181564.178507:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181564.178510:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181564.178520:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789181564.178523:0:126:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789181564.178525:0:126:0:(import.c:65:import_set_state_nolock()) ffff9c1de7ec7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181564.178531:0:126:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c1de7ec7800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181564.178624:0:126:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f04e00 x1876092408473856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181564.178677:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181564.178690:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408473600:0@lo:400:kworker.0 00000100:00100000:1.0:1789181564.178798:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181564.178938:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408473728:0@lo:38:kworker.0 00000100:00100000:1.0:1789181564.178967:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181564.178985:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876092408473856:0@lo:38:kworker.0 00000100:00100000:1.0:1789181564.179007:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181564.179042:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408473600 00000100:00100000:1.0:1789181564.179052:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408473600 00000100:00100000:1.0:1789181564.179094:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789181564.179102:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+12:3646:x1876092408473600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181564.179151:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+12:3646:x1876092408473600:12345-0@lo:400:kworker.0 Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181564.179158:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789181564.179524:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408473856 00000100:00100000:0.0:1789181564.179529:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408473856 00000100:00100000:1.0:1789181564.179638:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408473728 00000100:00100000:1.0:1789181564.179642:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408473728 00000100:00100000:0.0:1789181564.179705:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181564.179710:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876092408473856:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789181564.179744:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:0.0:1789181564.179784:0:17147:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x76fb5552835181ae 00000004:00100000:0.0:1789181564.179797:0:17147:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789181564.179936:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9c1dc6df4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181564.179992:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876092408473856:12345-0@lo:38:kworker.0 Request processed in 280us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181564.179998:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181564.180083:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181564.180089:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876092408473728:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789181564.180100:0:17151:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789181564.182324:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408473600:0@lo:400:kworker.0 00010000:00080000:0.0:1789181564.184512:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c1dc2f04e00 x1876092408473856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789181564.184534:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789181564.184544:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789181564.184550:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789181564.184553:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7ec7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789181564.184560:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876092408473856:0@lo:38:kworker.0 00000100:00100000:1.0:1789181564.198760:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876092408473728:12345-0@lo:38:kworker.0 Request processed in 18660us (19782us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789181564.198777:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789181564.199140:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf22000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181564.199146:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789181564.199150:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408473728:0@lo:38:kworker.0 00000020:00000004:3.0:1789181564.314780:0:17481:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181564.316598:0:17481:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789181564.428041:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181564.881112:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00000020:00000004:3.0:1789181565.249531:0:17531:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181565.250440:0:17531:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789181565.458796:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181565.900837:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:1.0:1789181566.477048:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181566.932143:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:3.0:1789181567.509236:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181567.948027:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00000100:00100000:0.0:1789181568.268883:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181558/real 1789181558] req@ffff9c1dff853100 x1876092408470784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181568 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181568.268915:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1dff853100 x1876092408470784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181568 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181568.268947:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181558/real 1789181558] req@ffff9c1dff850700 x1876092408470656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181568 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181568.268959:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1dff850700 x1876092408470656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181568 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789181568.268978:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181568.268993:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789181568.268997:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408470784:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789181568.269003:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f49000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181568.269007:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789181568.269010:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408470656:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789181568.269104:0:12254:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789181568.269108:0:12254:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789181568.269111:0:12254:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf22000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181568.269116:0:12254:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1789181568.269122:0:12254:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789181568.269134:0:12254:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c1dfaf22000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181568.269155:0:12254:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3849c00 x1876092408474112/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181568.269169:0:12254:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181568.269342:0:12254:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789181568.269344:0:12254:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f49000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181568.269348:0:12254:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:0.0:1789181568.269357:0:12254:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789181568.269362:0:12254:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c1de7f49000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181568.269375:0:12254:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc384ad80 x1876092408474240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181568.269384:0:12254:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181568.269387:0:12254:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789181568.269388:0:12254:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181568.269391:0:12254:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:0.0:1789181568.269394:0:12254:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789181568.269397:0:12254:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c1cc1d28000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181568.269406:0:12254:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3849880 x1876092408474368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789181568.269447:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408473984:0@lo:400:kworker.0 00000100:00100000:0.0:1789181568.269516:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181568.269589:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408474496:0@lo:400:kworker.0 00000100:00100000:0.0:1789181568.269616:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181568.269652:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408473984 00000100:00100000:0.0:1789181568.269660:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408473984 00000100:00100000:0.0:1789181568.269703:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789181568.269712:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:3646:x1876092408473984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181568.269790:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:3646:x1876092408473984:12345-0@lo:400:kworker.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181568.269798:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789181568.269879:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408473984:0@lo:400:kworker.0 00000100:00100000:0.0:1789181568.269895:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408474112:0@lo:38:kworker.0 00000100:00100000:0.0:1789181568.270275:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181568.270300:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408474240:0@lo:8:kworker.0 00000400:00000100:0.0:1789181568.270320:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092408474240 offset 0 length 520: 4 00000100:00100000:0.0:1789181568.270332:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408474368:0@lo:8:kworker.0 00000400:00000100:0.0:1789181568.270370:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092408474368 offset 0 length 520: 4 00000100:00100000:0.0:1789181568.270425:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408474112 00000100:00100000:0.0:1789181568.270430:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408474112 00000100:00100000:0.0:1789181568.270454:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181568.270459:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876092408474112:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789181568.270478:0:17150:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789181568.273119:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408474496 00000100:00100000:2.0:1789181568.273141:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408474496 00000100:00100000:2.0:1789181568.273336:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181568.273357:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408474496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181568.273448:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408474496:12345-0@lo:400:kworker.0 Request processed in 93us (3830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181568.273455:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789181568.273510:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c1cc3848000 x1876092408474496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181568.273525:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408474496:0@lo:400:kworker.0 00000100:00100000:0.0:1789181568.304439:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876092408474112:12345-0@lo:38:kworker.0 Request processed in 33968us (34154us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789181568.304454:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789181568.315997:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf22000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789181568.316014:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789181568.316019:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408474112:0@lo:38:kworker.0 00010000:00010000:0.0:1789181568.531613:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181568.973468:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:3.0:1789181569.548559:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181569.995829:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:1.0:1789181570.575075:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181570.968372:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789181571.019880:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:1.0:1789181571.596897:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181572.048859:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00000020:01000004:0.0:1789181572.413015:0:17876:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789181572.413019:0:17876:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789181572.413021:0:17876:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789181572.413137:0:17876:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c1dc6df7800 00000020:01000004:0.0:1789181572.413154:0:17876:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789181572.413167:0:17876:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789181572.413182:0:17876:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9c1dfaf499c0) 00000020:00000080:0.0:1789181572.413198:0:17876:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789181572.452506:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.453200:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789181572.454398:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789181572.454628:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789181572.455159:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789181572.455381:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789181572.455617:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789181572.455993:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789181572.456223:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789181572.456442:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789181572.456699:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789181572.457036:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789181572.457231:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789181572.457420:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1789181572.458842:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.459398:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789181572.460033:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789181572.460225:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789181572.460443:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789181572.460611:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.460869:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789181572.461126:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.461339:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789181572.461514:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.461835:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.462138:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.462343:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.462548:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.462781:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789181572.463032:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.463241:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789181572.463442:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789181572.463656:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789181572.464110:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789181572.464512:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1789181572.464746:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789181572.465009:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789181572.465173:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789181572.465349:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789181572.465567:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789181572.465825:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789181572.466045:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789181572.466266:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789181572.466662:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789181572.467019:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789181572.467236:0:17876:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00080000:01000000:2.0:1789181572.469263:0:17876:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789181572.469482:0:17876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789181572.469493:0:17876:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789181572.469511:0:17876:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb5552835181bc 00000020:01000004:2.0:1789181572.469518:0:17876:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789181572.469599:0:17876:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789181572.469603:0:17876:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789181572.469609:0:17876:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789181572.469634:0:17876:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789181572.469638:0:17876:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789181572.472968:0:17876:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789181572.473012:0:17876:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789181572.473018:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789181572.473019:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789181572.473021:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181572.473022:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181572.473023:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181572.473025:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181572.473026:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181572.473029:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181572.473030:0:17876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181572.473035:0:17876:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789181572.473037:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181572.473038:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789181572.473039:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181572.473041:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181572.473042:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181572.473043:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181572.473045:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181572.473046:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181572.473047:0:17876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181572.473077:0:17876:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789181572.473099:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408474624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789181572.473180:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181572.473306:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc26d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181572.473391:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408474624 00000100:00100000:0.0:1789181572.473399:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408474624 00000100:00100000:0.0:1789181572.473523:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181572.473543:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17876:x1876092408474624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789181572.473583:0:17140:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789181572.473587:0:17140:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789181572.473593:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789181572.473930:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+12:17876:x1876092408474624:12345-0@lo:253:mount.lustre.0 Request processed in 389us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.473939:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181572.474061:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408474624:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789181572.474073:0:17876:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789181572.474077:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789181572.474079:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789181572.474080:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181572.474081:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181572.474082:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181572.474083:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181572.474085:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789181572.474086:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181572.474087:0:17876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789181572.474106:0:17876:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c1dc6df7800 from lustre-MDT0001 10000000:01000000:3.0:1789181572.474135:0:17876:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789181572.474137:0:17876:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789181572.474143:0:17876:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c1dfaf48000 local copy 00010000:00010000:3.0:1789181572.474152:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181572.474233:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408474752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181572.474263:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.474500:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7fe3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181572.474582:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408474752 00000100:00100000:2.0:1789181572.474588:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408474752 00000100:00100000:2.0:1789181572.474616:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789181572.474631:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:17876:x1876092408474752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181572.474700:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:17876:x1876092408474752:12345-0@lo:501:mount.lustre.0 Request processed in 69us (435us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789181572.474707:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789181572.474850:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408474752:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789181572.474873:0:17876:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789181572.474901:0:17876:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789181572.474907:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.474916:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181572.474941:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c1dc6df7800 10000000:01000000:3.0:1789181572.474946:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789181572.474950:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c1dfaf48000 10000000:01000000:3.0:1789181572.474953:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789181572.474956:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c1dfaf48000 from 1 10000000:01000000:3.0:1789181572.474958:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789181572.474979:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb5552835181c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.474988:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb5552835181c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.474997:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb5552835181c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181572.475010:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408474880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181572.475036:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.475061:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7fe3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181572.475155:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408474880 00000100:00100000:2.0:1789181572.475159:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408474880 00000100:00100000:2.0:1789181572.475177:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181572.475182:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+12:17876:x1876092408474880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181572.475190:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181572.475203:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0084aa00/0x76fb5552835181ca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835181c3 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.475224:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0084aa00/0x76fb5552835181ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835181c3 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.475235:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0084aa00/0x76fb5552835181ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835181c3 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.475243:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084aa00, rc 0) 00000100:00100000:2.0:1789181572.475279:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+13:17876:x1876092408474880:12345-0@lo:101:mount.lustre.0 Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181572.475284:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181572.475344:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408474880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181572.475356:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb5552835181c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181ca expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.475370:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb5552835181c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835181ca expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181572.475383:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789181572.475431:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb5552835181c3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181ca expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.475439:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f200/0x76fb5552835181c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181ca expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181572.475447:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c1dc6df7800 10000000:01000000:3.0:1789181572.475451:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789181572.475454:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c1dc6df7800 from 1 10000000:01000000:3.0:1789181572.475456:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789181572.475469:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e400/0x76fb5552835181d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.475475:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e400/0x76fb5552835181d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.475482:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e400/0x76fb5552835181d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181572.475492:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181572.475516:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.475542:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7fe3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181572.475643:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408475008 00000100:00100000:0.0:1789181572.475648:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408475008 00000100:00100000:0.0:1789181572.475671:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789181572.475677:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+13:17876:x1876092408475008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181572.475684:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181572.475692:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f0800/0x76fb5552835181d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835181d1 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.475707:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f0800/0x76fb5552835181d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835181d1 expref: 14 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.475715:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f0800/0x76fb5552835181d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835181d1 expref: 14 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.475735:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0800, rc 0) 00000100:00100000:0.0:1789181572.475779:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+14:17876:x1876092408475008:12345-0@lo:101:mount.lustre.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.475785:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181572.475859:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181572.475869:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e400/0x76fb5552835181d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181d8 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.475895:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e400/0x76fb5552835181d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835181d8 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181572.475907:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789181572.476136:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e400/0x76fb5552835181d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181d8 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.476145:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e400/0x76fb5552835181d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181d8 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181572.476152:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789181572.476156:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789181572.476160:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c1dc6df7800 10000000:01000000:3.0:1789181572.476163:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789181572.476166:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789181572.476168:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789181572.476182:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ec00/0x76fb5552835181df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.476191:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ec00/0x76fb5552835181df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.476198:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ec00/0x76fb5552835181df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181572.476210:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181572.476234:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.476259:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7fe3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181572.476313:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408475136 00000100:00100000:0.0:1789181572.476317:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408475136 00000100:00100000:0.0:1789181572.476343:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789181572.476349:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+14:17876:x1876092408475136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181572.476363:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181572.476370:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f0000/0x76fb5552835181e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835181df expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.476383:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f0000/0x76fb5552835181e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835181df expref: 15 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.476390:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f0000/0x76fb5552835181e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835181df expref: 15 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.476397:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0000, rc 0) 00000100:00100000:0.0:1789181572.476425:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+15:17876:x1876092408475136:12345-0@lo:101:mount.lustre.0 Request processed in 77us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.476431:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789181572.476520:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181572.476539:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ec00/0x76fb5552835181df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181e6 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.476548:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ec00/0x76fb5552835181df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835181e6 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181572.477953:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789181572.478446:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181572.482265:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789181572.482334:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789181572.482349:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789181572.482361:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789181572.482373:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789181572.482386:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789181572.482400:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789181572.482414:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789181572.482429:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789181572.482442:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789181572.482456:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789181572.482470:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789181572.482484:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789181572.482500:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789181572.482514:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789181572.482602:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789181572.482620:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789181572.482633:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789181572.482646:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789181572.482658:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789181572.482676:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789181572.482689:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789181572.482704:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789181572.482951:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789181572.482960:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789181572.483077:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181572.483144:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.483224:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd233b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181572.483270:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408475264 00000100:00100000:2.0:1789181572.483278:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408475264 00000100:00100000:2.0:1789181572.483368:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789181572.483378:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+15:17876:x1876092408475264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181572.483565:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+15:17876:x1876092408475264:12345-0@lo:501:mount.lustre.0 Request processed in 188us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181572.483580:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789181572.483718:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181572.483963:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475392:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181572.484006:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.484033:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd233b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181572.484102:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408475392 00000100:00100000:1.0:1789181572.484107:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408475392 00000100:00100000:1.0:1789181572.484142:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789181572.484151:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+15:17876:x1876092408475392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181572.485013:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+15:17876:x1876092408475392:12345-0@lo:503:mount.lustre.0 Request processed in 859us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181572.485023:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789181572.485130:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475392:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789181572.485640:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181572.485747:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181572.485803:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.485830:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd12d4180 going to sleep for 11 seconds 00000100:00100000:0.0:1789181572.486092:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408475520 00000100:00100000:0.0:1789181572.486100:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408475520 00000100:00100000:0.0:1789181572.486132:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789181572.486140:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+15:17876:x1876092408475520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181572.486709:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+15:17876:x1876092408475520:12345-0@lo:502:mount.lustre.0 Request processed in 567us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.486718:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789181572.487058:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789181572.487249:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789181572.487274:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1789181572.487282:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1789181572.487289:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1789181572.487296:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1789181572.487302:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1789181572.487310:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1789181572.487317:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1789181572.487323:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1789181572.487330:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1789181572.487337:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1789181572.487344:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1789181572.487357:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1789181572.487364:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1789181572.487371:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1789181572.487377:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1789181572.487385:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1789181572.487392:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1789181572.487399:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1789181572.487405:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1789181572.487412:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1789181572.487419:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1789181572.487425:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1789181572.487432:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1789181572.487438:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1789181572.487445:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1789181572.487454:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1789181572.487468:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1789181572.487480:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1789181572.487492:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1789181572.487505:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1789181572.487519:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1789181572.487854:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1789181572.487875:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1789181572.487964:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1789181572.487983:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1789181572.487998:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1789181572.488011:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1789181572.488024:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1789181572.488038:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1789181572.488051:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1789181572.488063:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1789181572.488077:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1789181572.488090:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1789181572.488126:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181572.488191:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.488274:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd12d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181572.488379:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408475648 00000100:00100000:2.0:1789181572.488387:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408475648 00000100:00100000:1.0:1789181572.488613:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181572.488625:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+15:17876:x1876092408475648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181572.490226:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+15:17876:x1876092408475648:12345-0@lo:502:mount.lustre.0 Request processed in 1598us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181572.490239:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789181572.490362:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408475648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789181572.490458:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1789181572.490475:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789181572.491539:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181572.491551:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.491553:0:17880:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789181572.491559:0:17880:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789181572.491562:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181572.491577:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9c1dfaf4cd40) 00000020:00000080:0.0:1789181572.491598:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789181572.491604:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789181572.491700:0:17880:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789181572.491708:0:17880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb5552835181f4 00000020:00000080:0.0:1789181572.492165:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789181572.492170:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181572.492173:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.492175:0:17880:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789181572.492178:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181572.492182:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.492184:0:17880:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789181572.492187:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181572.492194:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9c1dfaf4b380) 00000020:00000080:0.0:1789181572.492205:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789181572.492209:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789181572.492211:0:17880:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789181572.492214:0:17880:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789181572.492221:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789181572.492265:0:17880:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1dc6df7800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789181572.492277:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9c1dc43919c0) 00000020:00000080:0.0:1789181572.492286:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789181572.492351:0:17880:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789181572.492357:0:17880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb555283518209 00000020:00000080:0.0:1789181572.492444:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789181572.492450:0:17880:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789181572.492455:0:17880:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x76fb555283518210 00080000:01000000:0.0:1789181572.492460:0:17880:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789181572.492464:0:17880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb555283518217 00010000:00010000:0.0:1789181572.544425:0:17880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1789181572.545179:0:17880:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1789181572.545657:0:17880:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789181572.548522:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789181572.548540:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181572.548548:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.548550:0:17880:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789181572.548561:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181572.548568:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.548570:0:17880:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789181572.548573:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789181572.548579:0:17880:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:00000080:0.0:1789181572.548610:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181572.548630:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9c1dc4390000) 00000020:00000080:0.0:1789181572.548659:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789181572.548664:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789181572.548798:0:17880:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789181572.548806:0:17880:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789181572.548813:0:17880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb555283518225 00010000:00080000:0.0:1789181572.548846:0:17880:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1e00841800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1789181572.550464:0:17880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789181572.555143:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789181572.555158:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789181572.555199:0:17880:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789181572.555219:0:17880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb55528351822c 00000100:00080000:0.0:1789181572.555228:0:17880:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789181572.555239:0:17880:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c1e00841800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181572.555278:0:17880:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3848e00 x1876092408475776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789181572.555346:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408475776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789181572.555415:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789181572.556639:0:17880:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789181572.556771:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181572.556778:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.556780:0:17880:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789181572.556784:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789181572.556787:0:17880:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789181572.556789:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789181572.556791:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789181572.556792:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789181572.556802:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.556803:0:17880:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789181572.556806:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181572.556811:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.556813:0:17880:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789181572.556816:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789181572.556865:0:17880:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789181572.556878:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181572.556882:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.556894:0:17880:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789181572.556897:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789181572.556899:0:17880:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1789181572.556901:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789181572.556902:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789181572.556904:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789181572.556907:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.556908:0:17880:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789181572.556910:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789181572.556914:0:17880:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789181572.556917:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181572.556918:0:17880:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789181572.556921:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789181572.556925:0:17880:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:0.0:1789181572.556948:0:17880:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789181572.556950:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181572.556966:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c1dc4393380) 00000020:00000080:0.0:1789181572.556982:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789181572.556986:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789181572.557055:0:17880:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789181572.557062:0:17880:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789181572.557071:0:17880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb55528351823a 00010000:00080000:0.0:1789181572.557100:0:17880:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1de7d92000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1789181572.557321:0:17880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1789181572.557565:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789181572.557570:0:253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789181572.557573:0:253:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf22000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181572.557580:0:253:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:0.0:1789181572.557585:0:253:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789181572.557593:0:253:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c1dfaf22000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181572.557625:0:253:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3849180 x1876092408475904/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789181572.558806:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408475904:0@lo:38:kworker.0 00000100:00100000:3.0:1789181572.558877:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789181572.559251:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181572.559256:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181572.559259:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181572.559262:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789181572.559316:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408476032:0@lo:400:kworker.0 00000100:00100000:0.0:1789181572.559350:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181572.559383:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408476032 00000100:00100000:0.0:1789181572.559392:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408476032 00000100:00100000:0.0:1789181572.559439:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181572.559449:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408476032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181572.559506:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408476032:12345-0@lo:400:kworker.0 Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.559513:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789181572.559554:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c1cc384bb80 x1876092408476032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181572.559569:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408476032:0@lo:400:kworker.0 00000040:01000000:1.0:1789181572.560319:0:17880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789181572.560530:0:17880:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789181572.562045:0:17880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181572.562323:0:17880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789181572.562467:0:17880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1789181572.562916:0:17885:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789181572.562921:0:17885:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1789181572.563072:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408475776 00000100:00100000:2.0:1789181572.563083:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408475776 00000100:00100000:2.0:1789181572.563108:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408475904 00000100:00100000:2.0:1789181572.563111:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408475904 00000100:00100000:2.0:1789181572.563126:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181572.563134:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876092408475776:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789181572.563163:0:17151:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1789181572.563199:0:17151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb555283518241 00000004:00100000:2.0:1789181572.563215:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789181572.563220:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000020:00000080:1.0:1789181572.564057:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789181572.564069:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789181572.564107:0:17880:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789181572.564126:0:17880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb555283518248 00000100:00080000:1.0:1789181572.564134:0:17880:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181572.564144:0:17880:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c1de7d92000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181572.564177:0:17880:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f06a00 x1876092408476160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789181572.564201:0:17880:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789181572.564232:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181572.564237:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181572.564239:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181572.564242:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789181572.564288:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181572.564293:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.564295:0:17880:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789181572.564298:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789181572.564307:0:17880:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1789181572.564309:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789181572.564311:0:17880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789181572.564312:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789181572.564315:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.564316:0:17880:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789181572.564318:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789181572.564322:0:17880:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789181572.564325:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.564326:0:17880:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789181572.564329:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789181572.564333:0:17880:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:1.0:1789181572.564354:0:17880:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789181572.564357:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789181572.564370:0:17880:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c1dd9303380) 00000020:00000080:1.0:1789181572.564383:0:17880:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789181572.564388:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789181572.564444:0:17880:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789181572.564450:0:17880:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789181572.564456:0:17880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x76fb555283518256 00010000:00080000:1.0:1789181572.564485:0:17880:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1cc1dcc000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.101@tcp at head 00000100:00100000:3.0:1789181572.564690:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408476160:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789181572.564775:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092408476160 offset 0 length 520: 4 00010000:00010000:1.0:1789181572.565289:0:17880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789181572.565364:0:17880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789181572.565382:0:17880:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789181572.567300:0:17880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181572.567509:0:17880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789181572.567689:0:17880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:3.0:1789181572.569599:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9c1dfb0fb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181572.569715:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1876092408475776:12345-0@lo:38:llog_process_th.0 Request processed in 6579us (14298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181572.569784:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181572.569816:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181572.569822:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876092408475904:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789181572.569865:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876092408475904:12345-0@lo:38:kworker.0 Request processed in 42us (10989us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789181572.569872:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181572.570011:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789181572.570019:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf22000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789181572.570023:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789181572.570027:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408475904:0@lo:38:kworker.0 00000100:00100000:1.0:1789181572.570053:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789181572.570060:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789181572.570069:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789181572.570075:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789181572.570078:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1e00841800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789181572.570098:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408475776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789181572.570253:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408476288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181572.570292:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181572.570505:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408476288 00000100:00100000:0.0:1789181572.570512:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408476288 00000100:00100000:0.0:1789181572.570563:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181572.570571:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1876092408476288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181572.570627:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789181572.570678:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1876092408476288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.570684:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181572.570824:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408476288:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789181572.571073:0:17887:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789181572.571078:0:17887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789181572.572037:0:17880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789181572.572050:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789181572.572088:0:17880:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789181572.572110:0:17880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb55528351825d 00000100:00080000:1.0:1789181572.572119:0:17880:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181572.572128:0:17880:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c1cc1dcc000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181572.572155:0:17880:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f05c00 x1876092408476416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789181572.572210:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408476416:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789181572.572254:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092408476416 offset 0 length 520: 4 00000100:00080000:1.0:1789181572.572303:0:17880:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789181572.572340:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181572.572344:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181572.572347:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181572.572349:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789181572.572391:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181572.572395:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.572397:0:17880:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789181572.572400:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181572.572412:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.572414:0:17880:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789181572.572417:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789181572.572419:0:17880:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789181572.572421:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181572.572423:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.572425:0:17880:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789181572.572427:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181572.572429:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.572430:0:17880:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789181572.572434:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789181572.572460:0:17880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181572.572464:0:17880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.572465:0:17880:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789181572.572468:0:17880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789181572.572695:0:17876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789181572.572775:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789181572.572792:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ec00/0x76fb5552835181df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181e6 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.572803:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085ec00/0x76fb5552835181df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835181e6 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181572.572812:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1dc6df7800 from 1 10000000:01000000:0.0:1789181572.572815:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789181572.572843:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.572850:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.572861:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181572.572959:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408476544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789181572.573003:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181572.573022:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7fac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181572.573046:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408476544 00000100:00100000:0.0:1789181572.573051:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408476544 00000100:00100000:0.0:1789181572.573094:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181572.573103:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+15:17876:x1876092408476544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181572.573115:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181572.573129:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f0a00/0x76fb55528351826b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283518264 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.573153:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f0a00/0x76fb55528351826b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283518264 expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.573164:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f0a00/0x76fb55528351826b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518264 expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.573173:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0a00, rc 0) 00000100:00100000:0.0:1789181572.573211:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+16:17876:x1876092408476544:12345-0@lo:101:mount.lustre.0 Request processed in 109us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.573218:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181572.573265:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408476544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181572.573277:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.573286:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181572.574127:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408476672:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789181572.574174:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181572.574247:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7fac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181572.574430:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408476672 00000100:00100000:2.0:1789181572.574437:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408476672 00000100:00100000:2.0:1789181572.574518:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789181572.574536:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+16:17876:x1876092408476672:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789181572.574554:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789181572.574571:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789181572.574575:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789181572.575206:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+16:17876:x1876092408476672:12345-0@lo:256:mount.lustre.0 Request processed in 669us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181572.575224:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789181572.575297:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408476672:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789181572.575930:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789181572.575949:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181572.575960:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181572.575968:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dc6df7800 from 1 10000000:01000000:1.0:1789181572.575970:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789181572.576009:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181572.576017:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181572.576026:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181572.576052:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408476800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789181572.576093:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181572.576416:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6d980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181572.576467:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408476800 00000100:00100000:0.0:1789181572.576474:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408476800 00000100:00100000:1.0:1789181572.576613:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789181572.576621:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+16:17876:x1876092408476800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181572.576633:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181572.576644:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1de0b12400/0x76fb555283518279 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283518272 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181572.576664:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1de0b12400/0x76fb555283518279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283518272 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181572.576675:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1de0b12400/0x76fb555283518279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518272 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181572.576684:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12400, rc 0) 00000100:00100000:1.0:1789181572.576749:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17876:x1876092408476800:12345-0@lo:101:mount.lustre.0 Request processed in 129us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181572.576756:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789181572.576848:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408476800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181572.576863:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.576871:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181572.577029:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181572.577064:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408476928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181572.577094:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.577119:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6d980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181572.577208:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408476928 00000100:00100000:1.0:1789181572.577213:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408476928 00000100:00100000:1.0:1789181572.577229:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789181572.577235:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17876:x1876092408476928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181572.577311:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17876:x1876092408476928:12345-0@lo:501:mount.lustre.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181572.577317:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789181572.577389:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408476928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181572.577413:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181572.577448:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.577465:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6d980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181572.577503:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408477056 00000100:00100000:1.0:1789181572.577508:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408477056 00000100:00100000:1.0:1789181572.577534:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789181572.577540:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17876:x1876092408477056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181572.577616:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17876:x1876092408477056:12345-0@lo:503:mount.lustre.0 Request processed in 76us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181572.577623:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181572.577776:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789181572.578141:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181572.578214:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181572.578251:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.578270:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7262180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181572.578396:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408477184 00000100:00100000:1.0:1789181572.578401:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408477184 00000100:00100000:1.0:1789181572.578424:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789181572.578431:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17876:x1876092408477184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181572.578529:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17876:x1876092408477184:12345-0@lo:502:mount.lustre.0 Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181572.578538:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181572.578780:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789181572.579076:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789181572.579107:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1789181572.579123:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1789181572.579137:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1789181572.579149:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1789181572.579161:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1789181572.579172:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1789181572.579184:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1789181572.579197:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789181572.579225:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1789181572.579239:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1789181572.579270:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181572.579315:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.579344:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7262180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181572.579396:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408477312 00000100:00100000:1.0:1789181572.579401:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408477312 00000100:00100000:1.0:1789181572.579425:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789181572.579432:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17876:x1876092408477312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181572.579516:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17876:x1876092408477312:12345-0@lo:502:mount.lustre.0 Request processed in 84us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181572.579533:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789181572.579773:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789181572.579820:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1789181572.579829:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789181572.580445:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181572.580457:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.580460:0:17889:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789181572.580468:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1dc6df7800 00000020:00000080:1.0:1789181572.580471:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181572.580480:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181572.580482:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.580490:0:17889:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789181572.580493:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181572.580495:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.580496:0:17889:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789181572.580500:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1dc6df7800 00000020:00000080:1.0:1789181572.580502:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181572.580635:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181572.580639:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.580641:0:17889:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789181572.580643:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181572.580646:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.580647:0:17889:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789181572.580651:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1dc6df7800 00000020:00000080:1.0:1789181572.580653:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181572.580670:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181572.580672:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.580673:0:17889:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789181572.580675:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181572.580677:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.580679:0:17889:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789181572.580682:0:17889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1dc6df7800 00000020:00000080:1.0:1789181572.580684:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181572.580705:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181572.580708:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181572.580710:0:17889:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789181572.580713:0:17889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1789181572.590838:0:17876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789181572.591838:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181572.591868:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.591882:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181572.592073:0:17876:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789181572.592076:0:17876:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c1dc6df7800 10000000:01000000:0.0:1789181572.592079:0:17876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c1dc6df7800 10000000:01000000:0.0:1789181572.592082:0:17876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789181572.592089:0:17876:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1dc6df7800 from 1 10000000:01000000:0.0:1789181572.592092:0:17876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181572.592134:0:17876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1e00/0x76fb555283518280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.592143:0:17876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1e00/0x76fb555283518280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.592153:0:17876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1e00/0x76fb555283518280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181572.592179:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789181572.592263:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181572.592314:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7fac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181572.592662:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408477440 00000100:00100000:1.0:1789181572.592670:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408477440 00000100:00100000:1.0:1789181572.592747:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789181572.592757:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17876:x1876092408477440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181572.592781:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181572.592793:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1de0b13400/0x76fb555283518287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283518280 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181572.592974:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1de0b13400/0x76fb555283518287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283518280 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181572.592984:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1de0b13400/0x76fb555283518287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518280 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181572.592992:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13400, rc 0) 00000100:00100000:1.0:1789181572.593039:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408477440:12345-0@lo:101:mount.lustre.0 Request processed in 284us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181572.593045:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789181572.593462:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181572.593479:0:17876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1e00/0x76fb555283518280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518287 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.593488:0:17876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1e00/0x76fb555283518280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518287 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789181572.597300:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789181572.597616:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181572.599853:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789181572.599973:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789181572.599990:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789181572.600002:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789181572.600015:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789181572.600177:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789181572.600191:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789181572.600203:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789181572.600215:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789181572.600228:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789181572.600240:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789181572.600268:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789181572.600283:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789181572.600295:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789181572.600306:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789181572.600318:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789181572.600332:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789181572.600344:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789181572.600467:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789181572.600483:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789181572.600506:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789181572.600519:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789181572.600531:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789181572.600544:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789181572.600558:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789181572.600572:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789181572.600585:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789181572.600611:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789181572.600637:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789181572.600643:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789181572.601164:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181572.601235:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181572.601325:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7fac840 going to sleep for 11 seconds 00000100:00100000:2.0:1789181572.613281:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408477568 00000100:00100000:2.0:1789181572.613297:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408477568 00000100:00100000:3.0:1789181572.613718:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789181572.613745:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408477568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181572.613963:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408477568:12345-0@lo:501:mount.lustre.0 Request processed in 219us (12727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181572.613972:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789181572.614833:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181572.614893:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477696:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181572.614948:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.614981:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd22c6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181572.615301:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408477696 00000100:00100000:2.0:1789181572.615308:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408477696 00000100:00100000:2.0:1789181572.615355:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789181572.615363:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408477696:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789181572.615453:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408477696:12345-0@lo:503:mount.lustre.0 Request processed in 91us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181572.615460:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789181572.615567:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477696:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789181572.616114:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181572.616202:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181572.616248:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.616274:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd22c6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181572.617136:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408477824 00000100:00100000:2.0:1789181572.617148:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408477824 00000100:00100000:2.0:1789181572.617196:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789181572.617207:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408477824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181572.619160:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408477824:12345-0@lo:502:mount.lustre.0 Request processed in 1946us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181572.619174:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:2.0:1789181572.620628:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181572.626325:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789181572.626881:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789181572.626920:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1789181572.626938:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1789181572.626964:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1789181572.626979:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1789181572.626994:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1789181572.627008:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1789181572.627039:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1789181572.627054:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1789181572.627070:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1789181572.627082:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1789181572.627094:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1789181572.627105:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1789181572.627123:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1789181572.627137:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1789181572.627169:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1789181572.627184:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1789181572.627197:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1789181572.627210:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1789181572.627223:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1789181572.627235:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1789181572.627249:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1789181572.627260:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1789181572.627271:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1789181572.627282:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1789181572.627295:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1789181572.627308:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1789181572.627321:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1789181572.627332:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1789181572.627344:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1789181572.627355:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1789181572.627381:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1789181572.627394:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1789181572.627405:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1789181572.627417:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1789181572.627428:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1789181572.627709:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1789181572.627751:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1789181572.627779:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1789181572.627794:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1789181572.627805:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1789181572.627818:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1789181572.627831:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1789181572.627844:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1789181572.627856:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1789181572.627866:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1789181572.627877:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1789181572.627905:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1789181572.627963:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181572.629619:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.629677:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd22c6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181572.629706:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408477952 00000100:00100000:3.0:1789181572.629716:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408477952 00000100:00100000:3.0:1789181572.629799:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789181572.629808:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408477952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181572.629954:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408477952:12345-0@lo:502:mount.lustre.0 Request processed in 145us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181572.629961:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789181572.630884:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408477952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789181572.631689:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1789181572.631717:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1789181572.631787:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408478080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181572.631851:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.631887:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd22c6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181572.631917:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408478080 00000100:00100000:3.0:1789181572.631923:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408478080 00000100:00100000:3.0:1789181572.631954:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789181572.631961:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408478080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181572.632703:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408478080:12345-0@lo:502:mount.lustre.0 Request processed in 739us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181572.632711:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789181572.632799:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408478080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789181572.632848:0:17876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1789181572.632858:0:17876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789181572.637263:0:17894:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789181572.637283:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9c1dc4394d40) 00000020:00000080:0.0:1789181572.637312:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789181572.637392:0:17894:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1dc6df7800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789181572.637397:0:17894:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1dc6df7800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789181572.637399:0:17894:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1dc6df7800 3 00010000:00080000:0.0:1789181572.637432:0:17894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1de60e5800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1789181572.640630:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789181572.642444:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789181572.642505:0:17894:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789181572.642525:0:17894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x76fb555283518295 00000100:00080000:0.0:1789181572.642538:0:17894:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789181572.642551:0:17894:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c1de60e5800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181572.642594:0:17894:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3848a80 x1876092408478208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789181572.642662:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876092408478208:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789181572.642760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789181572.644188:0:17894:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789181572.644222:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181572.644235:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181572.644238:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181572.644241:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789181572.647444:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:0.0:1789181572.648187:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408478208 00000100:00100000:0.0:1789181572.648198:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408478208 00000100:00100000:0.0:1789181572.648241:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181572.648250:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876092408478208:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789181572.648279:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1789181572.648315:0:17147:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x76fb55528351829c 00000004:00100000:0.0:1789181572.648331:0:17147:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789181572.648364:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9c1de60e2000 : changing import state from RECOVER to FULL 00000020:01000000:2.0:1789181572.648488:0:17876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789181572.648526:0:17876:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181572.648543:0:17876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1e00/0x76fb555283518280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518287 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.648554:0:17876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1e00/0x76fb555283518280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518287 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789181572.648617:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789181572.648623:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789181572.648625:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181572.648626:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181572.648626:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181572.648628:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181572.648629:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181572.648631:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181572.648632:0:17876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181572.648635:0:17876:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789181572.648638:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181572.648639:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789181572.648640:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181572.648641:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181572.648642:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181572.648642:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181572.648643:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181572.648644:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181572.648645:0:17876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181572.648668:0:17876:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789181572.648685:0:17876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408478336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789181572.648751:0:17876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181572.648798:0:17876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6887240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181572.653510:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408478336 00000100:00100000:3.0:1789181572.653526:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408478336 00000100:00100000:3.0:1789181572.653590:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789181572.653601:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408478336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789181572.653634:0:17139:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789181572.653648:0:17139:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789181572.654757:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876092408478208:12345-0@lo:38:llog_process_th.0 Request processed in 6473us (11963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.654778:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789181572.657522:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1cc3848a80 x1876092408478208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181572.657539:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181572.657550:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789181572.657561:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789181572.657568:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789181572.657573:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de60e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789181572.657583:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876092408478208:0@lo:38:llog_process_th.0 00000001:00100000:2.0:1789181572.664073:0:17125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789181572.664154:0:17139:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789181572.664168:0:17139:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789181572.664235:0:17161:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789181572.664239:0:17161:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789181572.664261:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.664283:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0084b200/0x76fb5552835181a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835181a0 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.664291:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1cc39f0a00/0x76fb55528351826b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518264 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.664299:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.664344:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1cc39f0a00/0x76fb55528351826b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283518264 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.664362:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1cc39f0a00/0x76fb55528351826b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283518264 expref: 18 pid: 17140 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181572.664378:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408478464:0@lo:104: 00000100:00100000:3.0:1789181572.664452:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181572.664546:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0084b200/0x76fb5552835181a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb5552835181a0 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.664555:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0084b200/0x76fb5552835181a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb5552835181a0 expref: 18 pid: 17139 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181572.664564:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408478592:0@lo:104: 00000100:00100000:3.0:1789181572.664594:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181572.665755:0:17161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df37fc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181572.666611:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17876:x1876092408478336:12345-0@lo:253:mount.lustre.0 Request processed in 13004us (17852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181572.666627:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789181572.668482:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408478464 00000100:00100000:2.0:1789181572.668499:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408478464 00000100:00100000:2.0:1789181572.668550:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408478592 00000100:00100000:2.0:1789181572.668554:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408478592 00000100:00100000:2.0:1789181572.668570:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181572.668579:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:868df35c-3970-416b-9e25-2e3d68c8633a+4:17161:x1876092408478464:12345-0@lo:104: 00010000:00010000:2.0:1789181572.668600:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.668740:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789181572.668747:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:868df35c-3970-416b-9e25-2e3d68c8633a+4:17161:x1876092408478464:12345-0@lo:104: Request processed in 169us (4297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181572.668774:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181572.668793:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181572.668799:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:868df35c-3970-416b-9e25-2e3d68c8633a+3:17161:x1876092408478592:12345-0@lo:104: 00010000:00010000:2.0:1789181572.668807:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.668841:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789181572.668846:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:868df35c-3970-416b-9e25-2e3d68c8633a+3:17161:x1876092408478592:12345-0@lo:104: Request processed in 49us (4252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181572.668853:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789181572.668869:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181572.668875:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181572.668997:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789181572.669107:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408478464:0@lo:104: 00000100:00100000:3.0:1789181572.669120:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408478592:0@lo:104: 00010000:00010000:3.0:1789181572.669152:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181572.669828:0:17876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:17876:1876092408478336:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789181572.669843:0:17876:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789181572.669847:0:17876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789181572.669848:0:17876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789181572.669850:0:17876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181572.669851:0:17876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181572.669852:0:17876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181572.669854:0:17876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181572.669855:0:17876:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789181572.669857:0:17876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181572.669858:0:17876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789181572.669874:0:17876:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789181572.671689:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1600 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181572.671704:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.671718:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181572.671741:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181572.671747:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181572.671813:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.671820:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181572.671857:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.671864:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1600/0x76fb555283518264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb55528351826b expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.671955:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181572.671959:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181572.671961:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181572.672128:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181572.672149:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408478720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181572.672219:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181572.672477:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408478720 00000100:00100000:0.0:1789181572.672485:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408478720 00010000:00010000:0.0:1789181572.672586:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1cc39f0a00/0x76fb55528351826b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283518264 expref: 18 pid: 17140 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181572.672626:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181572.672635:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:868df35c-3970-416b-9e25-2e3d68c8633a+18:3645:x1876092408478720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181572.672649:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181572.672656:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1cc39f0a00/0x76fb55528351826b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283518264 expref: 18 pid: 17140 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.672669:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1cc39f0a00/0x76fb55528351826b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283518264 expref: 18 pid: 17140 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.672694:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1cc39f0a00/0x76fb55528351826b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283518264 expref: 18 pid: 17140 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.672710:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181572.672801:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:868df35c-3970-416b-9e25-2e3d68c8633a+17:3645:x1876092408478720:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.672809:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181572.672849:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408478720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181572.674653:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181572.674665:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.674676:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085e600 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:0.0:1789181572.674680:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.674688:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181572.674695:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181572.674700:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181572.674756:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.674776:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181572.674796:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.674817:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e600/0x76fb5552835181a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835181a7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181572.674835:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181572.674837:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181572.674839:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181572.674865:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408478848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181572.675095:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181572.675153:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181572.675155:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181572.676603:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408478848 00000100:00100000:2.0:1789181572.676617:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408478848 00010000:00010000:2.0:1789181572.676664:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0084b200/0x76fb5552835181a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835181a0 expref: 17 pid: 17139 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181572.676708:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181572.676718:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:868df35c-3970-416b-9e25-2e3d68c8633a+17:3643:x1876092408478848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181572.676751:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181572.676757:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0084b200/0x76fb5552835181a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835181a0 expref: 17 pid: 17139 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676779:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0084b200/0x76fb5552835181a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb5552835181a0 expref: 17 pid: 17139 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676796:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0084b200/0x76fb5552835181a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb5552835181a0 expref: 17 pid: 17139 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676812:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676831:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789181572.676847:0:17132:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012608336s 00010000:00010000:2.0:1789181572.676853:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676859:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676866:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676872:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676878:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f000 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181572.676955:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676964:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676985:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181572.676995:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181572.677126:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:868df35c-3970-416b-9e25-2e3d68c8633a+16:3643:x1876092408478848:12345-0@lo:103:ldlm_bl.0 Request processed in 409us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181572.677134:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181572.677188:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408478848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181572.677399:0:17161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.677410:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181572.677416:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085f000/0x76fb5552835182a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1789181572.696034:0:17876:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789181572.696321:0:17902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789181572.696756:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789181572.698892:0:17876:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789181572.699345:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876092408478976:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789181572.699453:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181572.699503:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408478976 00000100:00100000:0.0:1789181572.699512:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408478976 00000100:00100000:0.0:1789181572.699587:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181572.699599:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876092408478976:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789181572.699676:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876092408478976:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.699685:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181572.699710:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181572.699771:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876092408478976:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789181572.699805:0:17903:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789181572.699835:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876092408479104:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789181572.699865:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181572.699893:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408479104 00000100:00100000:0.0:1789181572.699896:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408479104 00000100:00100000:0.0:1789181572.699912:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789181572.699917:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876092408479104:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789181572.700010:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876092408479104:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.700017:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789181572.700032:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181572.700044:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876092408479104:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789181572.700098:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17903:1876092408479232:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789181572.700125:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181572.700140:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181572.700313:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408479232 00000100:00100000:2.0:1789181572.700318:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408479232 00000100:00100000:2.0:1789181572.700354:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181572.700362:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1876092408479232:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789181572.700405:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1876092408479232:12345-0@lo:900:lod0001_rec0000.0 Request processed in 45us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181572.700412:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1789181572.700561:0:17876:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789181572.700609:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789181572.701062:0:17876:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789181572.701069:0:17876:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789181572.701107:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789181572.702063:0:17876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789181572.702517:0:17876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789181572.702540:0:17876:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789181572.702685:0:17876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1789181572.702850:0:17901:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789181572.702855:0:17901:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00010000:00080000:1.0:1789181572.703130:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1cc384a300 x1876092408479232/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789181588 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181572.703147:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17903:1876092408479232:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789181572.703242:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876092408479360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789181572.703324:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181572.703366:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6887240 going to sleep for 11 seconds 00080000:10000000:2.0:1789181572.703403:0:17876:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1789181572.703884:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408479360 00000100:00100000:0.0:1789181572.703892:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408479360 00000100:00100000:0.0:1789181572.703926:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000040:00080000:3.0:1789181572.703928:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1789181572.703936:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876092408479360:12345-0@lo:1000:lod0001_rec0000.0 00000004:00080000:3.0:1789181572.703982:0:17902:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789181572.704024:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1876092408479360:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 89us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181572.704031:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181572.704266:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1876092408479360:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789181572.704313:0:17903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:2.0:1789181572.707055:0:17876:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:1.0:1789181572.708103:0:17903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789181572.708171:0:17903:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789181572.708174:0:17903:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1789181572.726440:0:17876:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789181572.726481:0:17876:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa94541dab988 00100000:10000000:3.0:1789181572.726489:0:17876:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789181572.727015:0:17876:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789181572.727061:0:17876:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789181572.727078:0:17876:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789181572.727105:0:17876:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789181572.727834:0:17876:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181572.728043:0:17876:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789181573.068213:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:2.0:1789181573.643880:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181573.716627:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789181573.836802:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789181573.836813:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1dc6df7800 from 8 10000000:01000000:0.0:1789181573.836819:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789181573.836995:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181573.837012:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181573.837033:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181573.837063:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408479488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181573.837153:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181573.837228:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374900 going to sleep for 11 seconds 00000100:00100000:2.0:1789181573.837325:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408479488 00000100:00100000:2.0:1789181573.837348:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408479488 00000100:00100000:2.0:1789181573.837413:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789181573.837425:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+16:17142:x1876092408479488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181573.837451:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181573.837467:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0084ae00/0x76fb5552835182b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835182aa expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181573.837518:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0084ae00/0x76fb5552835182b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835182aa expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181573.837529:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0084ae00/0x76fb5552835182b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835182aa expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181573.837539:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084ae00, rc 0) 00000100:00100000:2.0:1789181573.837584:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+17:17142:x1876092408479488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181573.837591:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789181573.838247:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408479488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181573.838267:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181573.838278:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181573.838405:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408479616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789181573.838457:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181573.838601:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb374900 going to sleep for 11 seconds 00000100:00100000:2.0:1789181573.841090:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408479616 00000100:00100000:2.0:1789181573.841107:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408479616 00000100:00100000:2.0:1789181573.841177:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789181573.841188:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+17:17142:x1876092408479616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789181573.841219:0:17139:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789181573.841240:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789181573.841243:0:17139:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789181573.841593:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+17:17142:x1876092408479616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 407us (3134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181573.841602:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789181573.841760:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408479616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789181573.841857:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789181573.841867:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181573.841878:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181573.841887:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789181573.841890:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1cc44fb800 from 8 10000000:01000000:1.0:1789181573.841893:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789181573.841924:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181573.841932:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181573.841941:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181573.841959:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408479744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181573.842000:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181573.842026:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6887480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181573.842076:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408479744 00000100:00100000:2.0:1789181573.842082:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408479744 00000100:00100000:2.0:1789181573.842143:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789181573.842152:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17142:x1876092408479744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181573.842163:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181573.842179:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0084b000/0x76fb5552835182bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835182b8 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181573.842201:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0084b000/0x76fb5552835182bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835182b8 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181573.842212:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0084b000/0x76fb5552835182bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835182b8 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181573.842220:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084b000, rc 0) 00000100:00100000:2.0:1789181573.842255:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+18:17142:x1876092408479744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181573.842262:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789181573.842290:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408479744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181573.842302:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181573.842310:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181573.842348:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408479872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789181573.842377:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181573.845998:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408479872 00000100:00100000:3.0:1789181573.846011:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408479872 00000100:00100000:1.0:1789181573.846027:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6887480 going to sleep for 11 seconds 00000100:00100000:3.0:1789181573.846055:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789181573.846065:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17142:x1876092408479872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789181573.846091:0:17139:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789181573.846110:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789181573.846113:0:17139:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789181573.846251:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17142:x1876092408479872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (3871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181573.846259:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789181573.846288:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408479872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789181573.846340:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789181573.846350:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181573.846361:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181574.092125:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:1.0:1789181574.668040:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181574.733795:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789181575.115823:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:0.0:1789181575.693985:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181576.144333:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00010000:00010000:2.0:1789181576.715864:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181577.164106:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 0 seconds 00000001:02000400:3.0:1789181577.739305:0:18145:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789181577.739956:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789181577.996424:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789181577.996431:0:253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789181577.996435:0:253:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf22000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181577.996451:0:253:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c1dfaf22000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181577.996476:0:253:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3849180 x1876092408480128/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181577.996515:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181577.996519:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181577.996521:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181577.996524:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181577.996555:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181577.996558:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181577.996560:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181577.996563:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789181577.996591:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408480256:0@lo:400:kworker.0 00000100:00100000:0.0:1789181577.996657:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181577.996744:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181577.996751:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408480384:0@lo:400:kworker.0 00000100:00100000:0.0:1789181577.996779:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181577.996818:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408480384 00000100:00100000:0.0:1789181577.996825:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408480384 00000100:00100000:3.0:1789181577.996936:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408480512:0@lo:400:kworker.0 00000100:00100000:3.0:1789181577.996963:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181577.996987:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181577.996992:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408480000:0@lo:400:kworker.0 00000100:00100000:3.0:1789181577.997015:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181577.997046:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408480256 00000100:00100000:3.0:1789181577.997049:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408480256 00000100:00100000:3.0:1789181577.997082:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408480512 00000100:00100000:3.0:1789181577.997084:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408480512 00000100:00100000:3.0:1789181577.997097:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181577.997105:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408480256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181577.997151:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408480256:12345-0@lo:400:kworker.0 Request processed in 47us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181577.997158:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181577.997171:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181577.997183:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408480512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181577.997211:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408480512:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181577.997217:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181577.997237:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408480000 00000100:00100000:3.0:1789181577.997240:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408480000 00000100:00100000:3.0:1789181577.997263:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789181577.997268:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:3643:x1876092408480000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181577.997296:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:3643:x1876092408480000:12345-0@lo:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181577.997302:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789181577.997347:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408480000:0@lo:400:kworker.0 00010000:00080000:3.0:1789181577.997361:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1cc384bb80 x1876092408480512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181577.997372:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408480512:0@lo:400:kworker.0 00010000:00080000:3.0:1789181577.997405:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1cc3849c00 x1876092408480256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181577.997413:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408480256:0@lo:400:kworker.0 00000100:00100000:1.0:1789181577.997680:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408480128:0@lo:38:kworker.0 00000100:00100000:1.0:1789181577.997721:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181577.997979:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408480640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181577.998006:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181577.998257:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408480640 00000100:00100000:0.0:1789181577.998262:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408480640 00000100:00100000:0.0:1789181577.998275:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789181577.998281:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1876092408480384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181577.998329:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1876092408480384:12345-0@lo:400:kworker.0 Request processed in 48us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181577.998335:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789181577.998346:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181577.998359:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408480640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181577.998383:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789181577.998419:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408480640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181577.998424:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789181577.999205:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408480128 00000100:00100000:1.0:1789181577.999213:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408480128 00000100:00100000:1.0:1789181577.999246:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789181577.999258:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1876092408480128:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789181577.999281:0:17151:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1789181577.999314:0:17151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb5552835182c6 00000004:00100000:1.0:1789181577.999328:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789181577.999333:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789181577.999855:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408480640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181578.000127:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408480384:0@lo:400:kworker.0 00000100:00080000:1.0:1789181578.018178:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9c1dfb029000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181578.018332:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876092408480128:12345-0@lo:38:kworker.0 Request processed in 19069us (20615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181578.018346:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789181578.018708:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789181578.018749:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789181578.018755:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789181578.018759:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1dfaf22000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789181578.018779:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004c11f09c): req@ffff9c1cc3849500 x1876092408473216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181578.018800:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408480128:0@lo:38:kworker.0 00000100:00100000:0.0:1789181578.019807:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181578.019937:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd137be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181578.020004:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408473216 00000100:00100000:3.0:1789181578.020015:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408473216 00000100:00100000:3.0:1789181578.020095:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181578.020109:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17186:x1876092408473216:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789181578.020211:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17186:x1876092408473216:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181578.020238:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181578.020419:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181578.020431:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408480768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181578.020458:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181578.020481:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408480768 00000100:00100000:1.0:1789181578.020485:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408480768 00000100:00100000:1.0:1789181578.020500:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181578.020506:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408480768:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181578.020701:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17186:1876092408473216:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789181578.020771:0:17186:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789181578.020802:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17186:1876092408480896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789181578.020831:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181578.020927:0:17151:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789181578.021017:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d56c0 going to sleep for 11 seconds 00000004:00000024:1.0:1789181578.021403:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789181578.021465:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408480768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 958us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181578.021472:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181578.021679:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408480768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789181578.026913:0:17151:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789181578.027024:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408480896 00000100:00100000:1.0:1789181578.027037:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408480896 00000100:00100000:1.0:1789181578.027092:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181578.027105:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17186:x1876092408480896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789181578.027745:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17186:x1876092408480896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 610us (6879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181578.027766:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789181578.028175:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17186:1876092408480896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789181578.028317:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17186:1876092408481024:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789181578.028372:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181578.028811:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc10d56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181578.031288:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408481024 00000100:00100000:2.0:1789181578.031370:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408481024 00000100:00100000:2.0:1789181578.031462:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789181578.031474:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17186:x1876092408481024:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789181578.031638:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17186:x1876092408481024:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 166us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181578.031645:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181578.031755:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17186:1876092408481024:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789181578.031817:0:17186:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181578.033919:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789181578.034023:0:17186:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1789181578.034029:0:17186:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789181578.764625:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789181578.905131:0:18199:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789181578.905406:0:18199:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789181579.787901:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789181579.970564:0:18249:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789181579.971331:0:18249:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1789181580.172351:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789181580.812990:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789181581.256393:0:18298:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9cc786d0 20000000:00000080:3.0:1789181581.256416:0:18298:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c1dfdf8a000 uarg=0000000000000000 20000000:01000000:3.0:1789181581.256463:0:18298:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789181581.256471:0:18298:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789181581.256476:0:18298:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789181581.257488:0:18299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789181581.257662:0:18298:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789181581.263405:0:18298:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789181581.264126:0:18298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181581.264226:0:18298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1cc39f1000/0x76fb555283518176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351816f expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181581.264251:0:18298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1de0b12400/0x76fb555283518279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518272 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181581.264259:0:18298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181581.264313:0:18298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1de0b12400/0x76fb555283518279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283518272 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181581.264329:0:18298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1de0b12400/0x76fb555283518279 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283518272 expref: 17 pid: 17140 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181581.264346:0:18298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18298:1876092408481152:0@lo:104: 00000100:00100000:0.0:1789181581.264415:0:18298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181581.264517:0:18298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1cc39f1000/0x76fb555283518176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb55528351816f expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181581.264525:0:18298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1cc39f1000/0x76fb555283518176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb55528351816f expref: 17 pid: 17138 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181581.264533:0:18298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18298:1876092408481280:0@lo:104: 00000100:00100000:0.0:1789181581.264556:0:18298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181581.264633:0:18298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7c8b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181581.264846:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408481152 00000100:00100000:1.0:1789181581.264855:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408481152 00000100:00100000:3.0:1789181581.264945:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408481280 00000100:00100000:3.0:1789181581.264950:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408481280 00000100:00100000:3.0:1789181581.264993:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181581.265006:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:868df35c-3970-416b-9e25-2e3d68c8633a+4:18298:x1876092408481280:12345-0@lo:104: 00010000:00010000:3.0:1789181581.265021:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181581.265153:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181581.265160:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:868df35c-3970-416b-9e25-2e3d68c8633a+4:18298:x1876092408481280:12345-0@lo:104: Request processed in 157us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181581.265167:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789181581.265271:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181581.265278:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265287:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181581.265291:0:17897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265300:0:17897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181581.265308:0:17897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181581.265314:0:17897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181581.265348:0:17897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265354:0:17897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181581.265382:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265390:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0084b600/0x76fb55528351816f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518176 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265404:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181581.265406:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181581.265408:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181581.265419:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408481408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181581.265449:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181581.265485:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408481408 00000100:00100000:2.0:1789181581.265489:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408481408 00010000:00010000:2.0:1789181581.265507:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1cc39f1000/0x76fb555283518176 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb55528351816f expref: 18 pid: 17138 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181581.265526:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181581.265532:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:868df35c-3970-416b-9e25-2e3d68c8633a+18:3646:x1876092408481408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181581.265541:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181581.265545:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1cc39f1000/0x76fb555283518176 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb55528351816f expref: 18 pid: 17138 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265555:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1cc39f1000/0x76fb555283518176 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb55528351816f expref: 18 pid: 17138 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265569:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181581.265591:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:868df35c-3970-416b-9e25-2e3d68c8633a+18:3646:x1876092408481408:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181581.265597:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181581.265626:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408481408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181581.265765:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181581.265772:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+3:18298:x1876092408481152:12345-0@lo:104: 00010000:00010000:0.0:1789181581.265781:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181581.265820:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181581.265825:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+3:18298:x1876092408481152:12345-0@lo:104: Request processed in 54us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181581.265831:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789181581.265889:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181581.265894:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265901:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13a00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181581.265905:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265912:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181581.265919:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181581.265925:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181581.265949:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265956:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181581.265971:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265979:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb555283518272 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518279 expref: -99 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.265993:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181581.265994:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181581.265996:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181581.266003:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408481536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181581.266026:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181581.266058:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408481536 00000100:00100000:2.0:1789181581.266061:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408481536 00010000:00010000:2.0:1789181581.266074:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1de0b12400/0x76fb555283518279 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283518272 expref: 18 pid: 17140 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181581.266091:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181581.266096:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:868df35c-3970-416b-9e25-2e3d68c8633a+18:3643:x1876092408481536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181581.266102:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181581.266106:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1de0b12400/0x76fb555283518279 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283518272 expref: 18 pid: 17140 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266115:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1de0b12400/0x76fb555283518279 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283518272 expref: 18 pid: 17140 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266127:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266146:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266162:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266171:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266180:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266186:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266200:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181581.266205:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266213:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266221:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181581.266230:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181581.266252:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:868df35c-3970-416b-9e25-2e3d68c8633a+18:3643:x1876092408481536:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181581.266259:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181581.266280:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408481536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181581.266568:0:18298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1cc39f1000/0x76fb555283518176 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb55528351816f expref: 17 pid: 17138 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181581.266579:0:18298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18298:1876092408481280:0@lo:104: 00010000:00010000:1.0:1789181581.266589:0:18298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1de0b12400/0x76fb555283518279 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283518272 expref: 16 pid: 17140 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181581.266596:0:18298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18298:1876092408481152:0@lo:104: 00010000:00010000:1.0:1789181581.266610:0:18298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181581.266618:0:18298:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181581.266625:0:18298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181581.266631:0:18298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1cc39f0400/0x76fb5552835182cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181581.835998:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181582.093990:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181572/real 1789181572] req@ffff9c1dc2f05c00 x1876092408476416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181582 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181582.094025:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1dc2f05c00 x1876092408476416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181582 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181582.094049:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181572/real 1789181572] req@ffff9c1dc2f06a00 x1876092408476160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181582 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181582.094060:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1dc2f06a00 x1876092408476160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181582 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789181582.094084:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181582.094101:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789181582.094105:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408476416:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789181582.094111:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7d92000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181582.094117:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789181582.094120:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408476160:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789181582.094250:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789181582.094252:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:868df35c-3970-416b-9e25-2e3d68c8633a:3644:1876092408481664:0@lo:400:kworker.0 00000100:00080000:0.0:1789181582.094254:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181582.094258:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181582.094260:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181582.094284:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181582.094287:0:253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789181582.094289:0:253:0:(import.c:65:import_set_state_nolock()) ffff9c1de7d92000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181582.094294:0:253:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:0.0:1789181582.094300:0:253:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789181582.094309:0:253:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c1de7d92000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1789181582.094322:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181582.094328:0:253:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3ba6d80 x1876092408482176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181582.094339:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181582.094342:0:253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789181582.094343:0:253:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181582.094346:0:253:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:0.0:1789181582.094348:0:253:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789181582.094353:0:253:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c1cc1dcc000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181582.094362:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408482176:0@lo:8:kworker.0 00000100:00100000:2.0:1789181582.094379:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181582.094385:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408482048:0@lo:400:kworker.0 00000400:00000100:0.0:1789181582.094389:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092408482176 offset 0 length 520: 4 00000100:00100000:2.0:1789181582.094410:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181582.094418:0:253:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3ba6300 x1876092408482304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789181582.094434:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408481792:0@lo:400:kworker.0 00000100:00100000:0.0:1789181582.094447:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408482304:0@lo:8:kworker.0 00000100:00100000:2.0:1789181582.094457:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:0.0:1789181582.094475:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092408482304 offset 0 length 520: 4 00000100:00100000:2.0:1789181582.094485:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181582.094491:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408481920:0@lo:400:kworker.0 00000100:00100000:2.0:1789181582.094513:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181582.094546:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408481664 00000100:00100000:0.0:1789181582.094548:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408481920 00000100:00100000:2.0:1789181582.094556:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408481664 00000100:00100000:0.0:1789181582.094556:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408481920 00000100:00100000:2.0:1789181582.094598:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789181582.094598:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181582.094607:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+16:3644:x1876092408481664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181582.094607:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408481920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181582.094651:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+16:3644:x1876092408481664:12345-0@lo:400:kworker.0 Request processed in 46us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181582.094652:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408481920:12345-0@lo:400:kworker.0 Request processed in 48us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181582.094659:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789181582.094659:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181582.094701:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408482048 00000100:00100000:2.0:1789181582.094704:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408482048 00000100:00100000:2.0:1789181582.094764:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408481792 00000100:00100000:2.0:1789181582.094768:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408481792 00000100:00100000:2.0:1789181582.094784:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789181582.094789:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408482048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181582.094956:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181582.094966:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408482432:0@lo:400:kworker.0 00000100:00100000:3.0:1789181582.095000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181582.095028:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408482432 00000100:00100000:3.0:1789181582.095032:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408482432 00000100:00100000:3.0:1789181582.095052:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181582.095057:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408482432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181582.095089:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408482432:12345-0@lo:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181582.095102:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789181582.095133:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1cc3ba5f80 x1876092408482432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181582.095145:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408482432:0@lo:400:kworker.0 00000100:00100000:0.0:1789181582.095408:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789181582.095418:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408481792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181582.095449:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408482048:12345-0@lo:400:kworker.0 Request processed in 658us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181582.095455:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789181582.095464:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408481792:12345-0@lo:400:kworker.0 Request processed in 49us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181582.095469:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789181582.095988:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1cc3ba7800 x1876092408481920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181582.096000:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408481920:0@lo:400:kworker.0 00000100:00100000:2.0:1789181582.096012:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408481792:0@lo:400:kworker.0 00000100:00100000:2.0:1789181582.096040:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408482048:0@lo:400:kworker.0 00000100:00100000:2.0:1789181582.096049:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:868df35c-3970-416b-9e25-2e3d68c8633a:3644:1876092408481664:0@lo:400:kworker.0 00010000:00010000:2.0:1789181582.863254:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789181582.989950:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789181582.989959:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dc6df7800 from 13 10000000:01000000:3.0:1789181582.989965:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181582.990024:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181582.990038:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181582.990052:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181582.990081:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408482560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789181582.990529:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181582.990573:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd82bfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181582.990597:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408482560 00000100:00100000:3.0:1789181582.990604:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408482560 00000100:00100000:3.0:1789181582.990658:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789181582.990681:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+16:17142:x1876092408482560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181582.990697:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181582.990712:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085fa00/0x76fb5552835182db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835182d4 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181582.990760:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085fa00/0x76fb5552835182db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835182d4 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181582.990779:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085fa00/0x76fb5552835182db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835182d4 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181582.990789:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085fa00, rc 0) 00000100:00100000:3.0:1789181582.990830:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+17:17142:x1876092408482560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181582.990836:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789181582.990891:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408482560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181582.990905:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181582.990913:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181582.990983:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408482688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181582.991009:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181582.991024:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd82bfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181582.991036:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408482688 00000100:00100000:3.0:1789181582.991040:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408482688 00000100:00100000:3.0:1789181582.991062:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789181582.991069:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+17:17142:x1876092408482688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181582.991204:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+17:17142:x1876092408482688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181582.991211:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789181582.991238:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408482688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181582.991345:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408482816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181582.992107:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181582.992874:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd82bfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181582.992902:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408482816 00000100:00100000:3.0:1789181582.992910:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408482816 00000100:00100000:3.0:1789181582.992957:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789181582.992967:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17142:x1876092408482816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181582.993111:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+17:17142:x1876092408482816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181582.993332:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789181582.993529:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408482816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789181582.994853:0:18366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789181582.995067:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789181582.995093:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181582.995106:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181582.995760:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181582.995778:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789181582.995781:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1cc44fb800 from 13 10000000:01000000:3.0:1789181582.995784:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181582.995823:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181582.995832:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181582.995857:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181582.995887:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408482944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789181582.995969:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181582.996023:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd82bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181582.997760:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408482944 00000100:00100000:2.0:1789181582.997776:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408482944 00000100:00100000:2.0:1789181582.997844:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789181582.997856:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+17:17142:x1876092408482944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181582.997883:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181582.997901:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0084a800/0x76fb5552835182e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835182e2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181582.997929:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0084a800/0x76fb5552835182e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835182e2 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181582.997941:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0084a800/0x76fb5552835182e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835182e2 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181582.997949:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a800, rc 0) 00000100:00100000:2.0:1789181582.998034:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+18:17142:x1876092408482944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181582.998041:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789181582.998413:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408482944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181582.998446:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181582.998458:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181582.998887:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408483072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181582.998932:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181582.998975:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181582.999678:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408483072 00000100:00100000:3.0:1789181582.999688:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408483072 00000100:00100000:3.0:1789181582.999771:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789181582.999781:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17142:x1876092408483072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181583.000235:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:17142:x1876092408483072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 453us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181583.000244:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789181583.009791:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408483072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181583.009865:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408483200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181583.009950:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181583.009987:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc7e2b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181583.010050:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408483200 00000100:00100000:3.0:1789181583.010059:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408483200 00000100:00100000:3.0:1789181583.010122:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789181583.010131:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+18:17142:x1876092408483200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181583.010255:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+18:17142:x1876092408483200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181583.010263:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789181583.010311:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408483200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789181583.011194:0:18367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789181583.011250:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789181583.011272:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181583.011284:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181583.011308:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181583.116010:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181583.116038:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408483328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181583.116125:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181583.116381:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408483328 00000100:00100000:2.0:1789181583.116391:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408483328 00000100:00100000:2.0:1789181583.116564:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789181583.116577:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408483328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789181583.116620:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789181583.116695:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408483328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181583.116772:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408483328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181583.116938:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181568/real 1789181568] req@ffff9c1cc384ad80 x1876092408474240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181583 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181583.116975:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1cc384ad80 x1876092408474240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181583 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181583.116986:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181568/real 1789181568] req@ffff9c1cc3849880 x1876092408474368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181583 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181583.116998:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1cc3849880 x1876092408474368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181583 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789181583.117010:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f49000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181583.117024:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789181583.117027:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408474240:0@lo:8:kworker.0 00000100:00080000:0.0:1789181583.117032:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181583.117037:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789181583.117039:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408474368:0@lo:8:kworker.0 00000100:00080000:0.0:1789181583.117095:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181583.117099:0:253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789181583.117101:0:253:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f49000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181583.117105:0:253:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:0.0:1789181583.117109:0:253:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789181583.117116:0:253:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c1de7f49000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181583.117134:0:253:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3ba4000 x1876092408483712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181583.117146:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181583.117148:0:253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789181583.117155:0:253:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181583.117158:0:253:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:0.0:1789181583.117160:0:253:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789181583.117164:0:253:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c1cc1d28000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181583.117176:0:253:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3ba7480 x1876092408483840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181583.117192:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181583.117195:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181583.117198:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181583.117201:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789181583.117223:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408483712:0@lo:8:kworker.0 00000400:00000100:0.0:1789181583.117248:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092408483712 offset 0 length 520: 4 00000100:00100000:0.0:1789181583.117272:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408483840:0@lo:8:kworker.0 00000400:00000100:0.0:1789181583.117289:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092408483840 offset 0 length 520: 4 00000100:00100000:3.0:1789181583.117580:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408483584:0@lo:400:kworker.0 00000100:00100000:3.0:1789181583.117615:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181583.117638:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181583.117643:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408483968:0@lo:400:kworker.0 00000100:00100000:3.0:1789181583.117676:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181583.117713:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408483968 00000100:00100000:3.0:1789181583.117721:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408483968 00000100:00100000:3.0:1789181583.117785:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181583.117804:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408483968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181583.117845:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408483968:12345-0@lo:400:kworker.0 Request processed in 42us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181583.117851:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181583.117876:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408484096:0@lo:400:kworker.0 00000100:00100000:3.0:1789181583.117898:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181583.117917:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789181583.117922:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408483456:0@lo:400:kworker.0 00000100:00100000:3.0:1789181583.117945:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181583.117958:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408484224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181583.117974:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181583.117992:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408484096 00000100:00100000:3.0:1789181583.118007:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408484096 00000100:00100000:3.0:1789181583.118030:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181583.118036:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408484096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181583.118066:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408484096:12345-0@lo:400:kworker.0 Request processed in 31us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181583.118072:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181583.118090:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408483456 00000100:00100000:3.0:1789181583.118092:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408483456 00000100:00100000:3.0:1789181583.118113:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181583.118119:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:3645:x1876092408483456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181583.118145:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:3645:x1876092408483456:12345-0@lo:400:kworker.0 Request processed in 26us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181583.118150:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181583.118185:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408483456:0@lo:400:kworker.0 00010000:00080000:3.0:1789181583.118197:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1cc3ba7800 x1876092408484096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181583.118206:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408484096:0@lo:400:kworker.0 00010000:00080000:3.0:1789181583.118231:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1cc3ba7100 x1876092408483968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181583.118238:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408483968:0@lo:400:kworker.0 00000100:00100000:1.0:1789181583.123642:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408483584 00000100:00100000:1.0:1789181583.123687:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408483584 00000100:00100000:1.0:1789181583.123740:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408484224 00000100:00100000:1.0:1789181583.123743:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408484224 00000100:00100000:1.0:1789181583.123762:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181583.123773:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3643:x1876092408483584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181583.125908:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3643:x1876092408483584:12345-0@lo:400:kworker.0 Request processed in 2126us (8281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181583.125924:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181583.125959:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181583.125971:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408484224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789181583.126003:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789181583.126048:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408484224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (8072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181583.126055:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181583.126113:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408484224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181583.126312:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408483584:0@lo:400:kworker.0 00000100:00100000:2.0:1789181583.128651:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789181583.884936:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789181584.157208:0:17877:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789181584.907971:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181584.973361:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789181585.932051:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181586.973257:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181587.984559:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789181588.235841:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181588.235848:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181588.235851:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181588.235855:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181588.235876:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181588.235890:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789181588.235893:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181588.235896:0:253:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789181588.235936:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408484608:0@lo:400:kworker.0 00000100:00100000:0.0:1789181588.236008:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181588.236066:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181588.236072:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408484736:0@lo:400:kworker.0 00000100:00100000:0.0:1789181588.236094:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181588.236245:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408484352:0@lo:400:kworker.0 00000100:00100000:3.0:1789181588.236276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181588.236298:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408484864:0@lo:400:kworker.0 00000100:00100000:3.0:1789181588.236339:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181588.236360:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789181588.236366:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408484480:0@lo:400:kworker.0 00000100:00100000:1.0:1789181588.236368:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408484608 00000100:00100000:1.0:1789181588.236375:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408484608 00000100:00100000:3.0:1789181588.236396:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181588.236419:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408484864 00000100:00100000:1.0:1789181588.236421:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408484864 00000100:00100000:3.0:1789181588.236422:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408484992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181588.236441:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181588.236443:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181588.236451:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408484608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181588.236507:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408484608:12345-0@lo:400:kworker.0 Request processed in 56us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181588.236514:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181588.236530:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181588.236536:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408484864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181588.236567:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408484864:12345-0@lo:400:kworker.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181588.236573:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181588.236589:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408484736 00000100:00100000:1.0:1789181588.236593:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408484736 00000100:00100000:1.0:1789181588.236609:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408484480 00000100:00100000:1.0:1789181588.236611:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408484480 00000100:00100000:1.0:1789181588.236632:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408484992 00000100:00100000:1.0:1789181588.236634:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408484992 00000100:00100000:1.0:1789181588.236645:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789181588.236651:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408484736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181588.236675:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181588.236682:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408484736:12345-0@lo:400:kworker.0 Request processed in 32us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181588.236683:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408484480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181588.236688:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789181588.236699:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181588.236705:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408484992:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181588.236711:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876092408484480:12345-0@lo:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181588.236717:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789181588.236754:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408484352 00000100:00100000:3.0:1789181588.236758:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408484352 00000100:00100000:3.0:1789181588.236786:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789181588.236792:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+18:3643:x1876092408484352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181588.236824:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+18:3643:x1876092408484352:12345-0@lo:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181588.236829:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789181588.236874:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408484480:0@lo:400:kworker.0 00000100:00100000:3.0:1789181588.236882:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408484352:0@lo:400:kworker.0 00010000:00080000:3.0:1789181588.236892:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1cc3ba5880 x1876092408484864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181588.236901:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408484864:0@lo:400:kworker.0 00000100:00100000:2.0:1789181588.237564:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181588.237583:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408485120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789181588.237633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181588.240002:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408485120 00000100:00100000:2.0:1789181588.240031:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408485120 00000100:00100000:2.0:1789181588.240093:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789181588.240103:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408485120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789181588.240139:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789181588.240214:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408485120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181588.240221:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789181588.240272:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408485120:0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181588.240420:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789181588.240475:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408484992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3769us (4032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181588.240482:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181588.240548:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408484736:0@lo:400:kworker.0 00010000:00080000:1.0:1789181588.240564:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1cc3ba7b80 x1876092408484608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181588.240576:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408484608:0@lo:400:kworker.0 00000100:00100000:2.0:1789181588.241070:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408484992:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789181589.007904:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789181589.562295:0:18646:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789181589.562299:0:18646:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789181589.562300:0:18646:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789181589.562496:0:18646:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c1df3d93800 00000020:01000004:1.0:1789181589.562513:0:18646:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789181589.562528:0:18646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789181589.562543:0:18646:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c1dd93019c0) 00000020:00000080:1.0:1789181589.562567:0:18646:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789181589.644892:0:18646:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789181589.645316:0:18646:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789181589.645889:0:18646:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789181589.646077:0:18646:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789181589.646285:0:18646:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789181589.646491:0:18646:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789181589.646918:0:18646:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1789181589.650211:0:18646:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789181589.650476:0:18646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789181589.650989:0:18646:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789181589.651075:0:18646:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x76fb5552835182f7 00000020:01000004:1.0:1789181589.651084:0:18646:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789181589.651110:0:18646:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789181589.651113:0:18646:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789181589.651120:0:18646:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789181589.651125:0:18646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789181589.651140:0:18646:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c1dd9300000) 00000020:00000080:1.0:1789181589.651164:0:18646:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789181589.652671:0:18646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181589.654282:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789181589.654290:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789181589.668918:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789181589.668936:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789181589.669649:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789181589.669657:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789181589.672238:0:18646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181589.672685:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789181589.672693:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789181589.674453:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789181589.674465:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789181589.719501:0:18646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181589.720224:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789181589.720231:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789181589.722661:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789181589.722677:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789181589.724316:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789181589.724328:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789181589.727009:0:18646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181589.727237:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789181589.727244:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789181589.731001:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789181589.731016:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789181589.789491:0:18646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181589.790131:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789181589.790140:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789181589.792079:0:18646:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789181589.792093:0:18646:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789181589.792660:0:18646:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789181589.792691:0:18646:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789181589.792698:0:18646:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789181589.826713:0:18646:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789181589.826808:0:18646:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789181589.826814:0:18646:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789181589.826816:0:18646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181589.826818:0:18646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181589.826819:0:18646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181589.826821:0:18646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181589.826823:0:18646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181589.826825:0:18646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181589.826826:0:18646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181589.826828:0:18646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789181589.826833:0:18646:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789181589.826836:0:18646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789181589.826837:0:18646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181589.826838:0:18646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181589.826839:0:18646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181589.826840:0:18646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181589.826842:0:18646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181589.826843:0:18646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181589.826844:0:18646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181589.826845:0:18646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789181589.826879:0:18646:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789181589.826906:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789181589.827300:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181589.827488:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408485248 00000100:00100000:0.0:1789181589.827498:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408485248 00000100:00100000:0.0:1789181589.827573:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789181589.827585:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+18:18646:x1876092408485248:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789181589.827634:0:17140:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789181589.827637:0:17140:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789181589.827641:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789181589.828149:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+18:18646:x1876092408485248:12345-0@lo:253:mount.lustre.0 Request processed in 564us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181589.828157:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789181589.828208:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dcf606b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181589.828236:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485248:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789181589.828249:0:18646:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789181589.828252:0:18646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789181589.828254:0:18646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789181589.828255:0:18646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789181589.828257:0:18646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789181589.828258:0:18646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789181589.828259:0:18646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789181589.828271:0:18646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789181589.828272:0:18646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789181589.828274:0:18646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789181589.828298:0:18646:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c1df3d93800 from lustre-OST0000 10000000:01000000:0.0:1789181589.828331:0:18646:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789181589.828334:0:18646:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789181589.828342:0:18646:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c1dfaf48000 local copy 00010000:00010000:0.0:1789181589.828353:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181589.828564:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181589.828598:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181589.828663:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181589.832101:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408485376 00000100:00100000:3.0:1789181589.832121:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408485376 00000100:00100000:1.0:1789181589.834946:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789181589.834963:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:18646:x1876092408485376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181589.835370:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+18:18646:x1876092408485376:12345-0@lo:501:mount.lustre.0 Request processed in 401us (6761us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181589.835381:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789181589.835593:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485376:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789181589.835980:0:18646:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789181589.836026:0:18646:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789181589.836036:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.836046:0:18646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181589.836094:0:18646:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c1df3d93800 10000000:01000000:1.0:1789181589.836100:0:18646:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789181589.836106:0:18646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789181589.836108:0:18646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789181589.836113:0:18646:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789181589.836116:0:18646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789181589.836150:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12a00/0x76fb555283518305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.836159:0:18646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12a00/0x76fb555283518305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.836170:0:18646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12a00/0x76fb555283518305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181589.836189:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789181589.836231:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.836270:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181589.836321:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408485504 00000100:00100000:3.0:1789181589.836328:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408485504 00000100:00100000:3.0:1789181589.836373:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789181589.836382:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+18:18646:x1876092408485504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181589.836393:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181589.836407:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351830c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283518305 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.836430:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351830c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283518305 expref: 19 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.836448:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085ee00/0x76fb55528351830c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518305 expref: 19 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.836456:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085ee00, rc 0) 00000100:00100000:3.0:1789181589.836496:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+19:18646:x1876092408485504:12345-0@lo:101:mount.lustre.0 Request processed in 115us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181589.836503:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789181589.836785:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181589.836800:0:18646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12a00/0x76fb555283518305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351830c expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.836811:0:18646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12a00/0x76fb555283518305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351830c expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789181589.838482:0:18646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789181589.839590:0:18646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181589.843108:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789181589.843171:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789181589.843187:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789181589.843200:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789181589.843213:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789181589.843226:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789181589.843251:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789181589.843257:0:18646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789181589.843378:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181589.843447:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181589.843497:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789181589.844140:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408485632 00000100:00100000:1.0:1789181589.844150:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408485632 00000100:00100000:1.0:1789181589.844213:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789181589.844233:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+19:18646:x1876092408485632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181589.844424:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+19:18646:x1876092408485632:12345-0@lo:501:mount.lustre.0 Request processed in 191us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181589.844433:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789181589.844764:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181589.844808:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789181589.844853:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181589.844886:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181589.844956:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408485760 00000100:00100000:3.0:1789181589.844961:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408485760 00000100:00100000:3.0:1789181589.844997:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789181589.845016:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+19:18646:x1876092408485760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181589.846431:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+19:18646:x1876092408485760:12345-0@lo:503:mount.lustre.0 Request processed in 1406us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181589.846443:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789181589.846663:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485760:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789181589.847314:0:18646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789181589.847428:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181589.847486:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181589.847704:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408485888 00000100:00100000:2.0:1789181589.847712:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408485888 00000100:00100000:2.0:1789181589.847795:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789181589.847805:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+19:18646:x1876092408485888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181589.848699:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+19:18646:x1876092408485888:12345-0@lo:502:mount.lustre.0 Request processed in 892us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181589.848716:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789181589.848937:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181589.848959:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408485888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789181589.849310:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789181589.849341:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789181589.849355:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789181589.849442:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789181589.849458:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789181589.849470:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789181589.849483:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789181589.849497:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789181589.850048:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789181589.850067:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789181589.850080:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789181589.850092:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789181589.850133:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181589.850206:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.850249:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181589.851802:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408486016 00000100:00100000:2.0:1789181589.851819:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408486016 00000100:00100000:2.0:1789181589.851897:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789181589.851909:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+19:18646:x1876092408486016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181589.852321:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+19:18646:x1876092408486016:12345-0@lo:502:mount.lustre.0 Request processed in 413us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181589.852331:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789181589.852497:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789181589.852588:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789181589.852630:0:18646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789181589.854996:0:18663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789181589.855023:0:18663:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789181589.855045:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.855048:0:18663:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789181589.855056:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789181589.855075:0:18663:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c1cc32619c0) 00000020:00000080:3.0:1789181589.855103:0:18663:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789181589.855109:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789181589.855198:0:18663:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1df3d93800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789181589.855207:0:18663:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789181589.855213:0:18663:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x76fb55528351831a 00010000:00010000:3.0:1789181589.858301:0:18663:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789181589.862517:0:18663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789181589.866053:0:18663:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1789181589.868712:0:18663:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789181589.868758:0:18663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181589.868765:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.868767:0:18663:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789181589.868771:0:18663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789181589.868774:0:18663:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1789181589.868776:0:18663:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789181589.868778:0:18663:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789181589.868780:0:18663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789181589.868782:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.868784:0:18663:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789181589.868786:0:18663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181589.868789:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.868791:0:18663:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789181589.868795:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789181589.868797:0:18663:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789181589.868799:0:18663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181589.868802:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.868803:0:18663:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789181589.868806:0:18663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181589.868808:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.868809:0:18663:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789181589.868812:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789181589.868845:0:18663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181589.868848:0:18663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.868849:0:18663:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789181589.868853:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789181589.869175:0:18646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789181589.869207:0:18646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789181589.869231:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12a00/0x76fb555283518305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351830c expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.869245:0:18646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12a00/0x76fb555283518305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351830c expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181589.869253:0:18646:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1df3d93800 from 1 10000000:01000000:1.0:1789181589.869256:0:18646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789181589.869291:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.869302:0:18646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.869314:0:18646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181589.869339:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789181589.869417:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.869460:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181589.869697:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408486144 00000100:00100000:0.0:1789181589.869706:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408486144 00000100:00100000:0.0:1789181589.869933:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789181589.869944:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+19:18646:x1876092408486144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181589.869960:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181589.870146:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f0400/0x76fb555283518328 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283518321 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181589.870175:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f0400/0x76fb555283518328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283518321 expref: 20 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181589.870186:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f0400/0x76fb555283518328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518321 expref: 20 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181589.870195:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0400, rc 0) 00000100:00100000:0.0:1789181589.870253:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+20:18646:x1876092408486144:12345-0@lo:101:mount.lustre.0 Request processed in 312us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181589.870261:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789181589.870344:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181589.870375:0:18646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.870385:0:18646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181589.871432:0:18646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789181589.871675:0:18646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181589.872080:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789181589.872107:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789181589.872128:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789181589.872135:0:18646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789181589.872202:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181589.872258:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.872350:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181589.872456:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408486272 00000100:00100000:0.0:1789181589.872466:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408486272 00000100:00100000:0.0:1789181589.872552:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789181589.872564:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+20:18646:x1876092408486272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181589.872690:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+20:18646:x1876092408486272:12345-0@lo:501:mount.lustre.0 Request processed in 127us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181589.872698:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789181589.872797:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181589.872834:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181589.872880:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.873073:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181589.873158:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408486400 00000100:00100000:3.0:1789181589.873165:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408486400 00000100:00100000:3.0:1789181589.873191:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789181589.873199:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+20:18646:x1876092408486400:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181589.873291:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+20:18646:x1876092408486400:12345-0@lo:503:mount.lustre.0 Request processed in 92us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181589.873308:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789181589.873394:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789181589.873968:0:18646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789181589.874125:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181589.874173:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.874202:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181589.874273:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408486528 00000100:00100000:3.0:1789181589.874280:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408486528 00000100:00100000:3.0:1789181589.874307:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789181589.874314:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+20:18646:x1876092408486528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181589.874429:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+20:18646:x1876092408486528:12345-0@lo:502:mount.lustre.0 Request processed in 114us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181589.874437:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789181589.874571:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789181589.874877:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789181589.874904:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789181589.874920:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789181589.874934:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789181589.874948:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789181589.874962:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789181589.874987:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789181589.875078:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789181589.875099:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789181589.875113:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789181589.875127:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789181589.875159:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181589.875213:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.875246:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd3697540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181589.875316:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408486656 00000100:00100000:3.0:1789181589.875322:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408486656 00000100:00100000:3.0:1789181589.875353:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789181589.875435:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+20:18646:x1876092408486656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181589.875539:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+20:18646:x1876092408486656:12345-0@lo:502:mount.lustre.0 Request processed in 177us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181589.875547:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789181589.875633:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789181589.875671:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789181589.875679:0:18646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789181589.876455:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181589.876465:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.876467:0:18666:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789181589.876474:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1df3d93800 00000020:00000080:3.0:1789181589.876477:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789181589.876484:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181589.876487:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.876488:0:18666:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789181589.876491:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181589.876493:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.876494:0:18666:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789181589.876497:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1df3d93800 00000020:00000080:3.0:1789181589.876499:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789181589.876550:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181589.876553:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.876554:0:18666:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789181589.876557:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181589.876559:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.876560:0:18666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789181589.876564:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1df3d93800 00000020:00000080:3.0:1789181589.876566:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789181589.876581:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181589.876584:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.876585:0:18666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789181589.876587:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181589.876590:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.876591:0:18666:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789181589.876594:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1df3d93800 00000020:00000080:3.0:1789181589.876596:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789181589.876628:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181589.876630:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181589.876632:0:18666:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789181589.876635:0:18666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789181589.877226:0:18646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789181589.877251:0:18646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789181589.877303:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.877316:0:18646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181589.877380:0:18646:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789181589.877384:0:18646:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c1df3d93800 10000000:01000000:1.0:1789181589.877386:0:18646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c1df3d93800 10000000:01000000:1.0:1789181589.877390:0:18646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789181589.877396:0:18646:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1df3d93800 from 1 10000000:01000000:1.0:1789181589.877398:0:18646:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789181589.877431:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb55528351832f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.877440:0:18646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb55528351832f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.877462:0:18646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb55528351832f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181589.877483:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486784:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789181589.877533:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.877576:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd36970c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181589.877637:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408486784 00000100:00100000:0.0:1789181589.877644:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408486784 00000100:00100000:0.0:1789181589.877689:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789181589.877697:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+20:18646:x1876092408486784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181589.877715:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181589.877749:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f1c00/0x76fb555283518336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351832f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181589.877774:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f1c00/0x76fb555283518336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351832f expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181589.877784:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f1c00/0x76fb555283518336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351832f expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181589.877793:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1c00, rc 0) 00000100:00100000:0.0:1789181589.877830:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408486784:12345-0@lo:101:mount.lustre.0 Request processed in 134us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181589.877837:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789181589.878073:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181589.878089:0:18646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb55528351832f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518336 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181589.878099:0:18646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb55528351832f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518336 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789181589.881131:0:18646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789181589.881440:0:18646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181589.881614:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789181589.881639:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789181589.881653:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789181589.881666:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789181589.881678:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789181589.881690:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789181589.881702:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789181589.881714:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789181589.881816:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789181589.881835:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789181589.881849:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789181589.881861:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789181589.881874:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789181589.881887:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789181589.881908:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789181589.881920:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789181589.881933:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789181589.881944:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789181589.881956:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789181589.881968:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789181589.881981:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789181589.881995:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789181589.882082:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789181589.882099:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789181589.882112:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1789181589.882124:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1789181589.882137:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1789181589.882149:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1789181589.882161:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1789181589.882187:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1789181589.882201:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1789181589.882213:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1789181589.882225:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1789181589.882237:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1789181589.882249:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1789181589.882262:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1789181589.882275:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1789181589.882294:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1789181589.882299:0:18646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789181589.882383:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181589.882446:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181589.882488:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181589.882517:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408486912 00000100:00100000:0.0:1789181589.882524:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408486912 00000100:00100000:0.0:1789181589.882569:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789181589.882578:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408486912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181589.882708:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408486912:12345-0@lo:501:mount.lustre.0 Request processed in 130us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181589.882716:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789181589.883917:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408486912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181589.884155:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408487040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789181589.884210:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181589.884248:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181589.884934:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408487040 00000100:00100000:0.0:1789181589.884942:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408487040 00000100:00100000:0.0:1789181589.884994:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789181589.885078:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408487040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789181589.885224:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408487040:12345-0@lo:503:mount.lustre.0 Request processed in 221us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181589.885232:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789181589.885291:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408487040:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789181589.887985:0:18646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789181589.888154:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408487168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181589.888242:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181589.888286:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181589.888316:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408487168 00000100:00100000:0.0:1789181589.888322:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408487168 00000100:00100000:0.0:1789181589.889820:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789181589.889840:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408487168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181589.890076:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408487168:12345-0@lo:502:mount.lustre.0 Request processed in 170us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181589.890091:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789181589.890169:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408487168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789181589.890893:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789181589.890930:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789181589.890944:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789181589.890956:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789181589.890985:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789181589.891455:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789181589.891471:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789181589.891484:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789181589.891498:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789181589.891510:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789181589.891524:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789181589.891537:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789181589.891548:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789181589.891561:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789181589.891574:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789181589.891588:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789181589.891612:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789181589.891629:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789181589.891641:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789181589.891655:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789181589.891685:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789181589.891699:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789181589.891711:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789181589.892451:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789181589.892481:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789181589.892492:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789181589.892503:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789181589.892513:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789181589.892536:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789181589.892547:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789181589.892557:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789181589.892568:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789181589.892578:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789181589.892588:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789181589.892599:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789181589.892622:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789181589.892644:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789181589.892655:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789181589.892666:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789181589.892676:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789181589.892687:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789181589.892698:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789181589.892708:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789181589.892718:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789181589.893139:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789181589.893154:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789181589.893166:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789181589.893177:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789181589.893237:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408487296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181589.893329:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181589.894940:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1540 going to sleep for 11 seconds 00000100:00100000:1.0:1789181589.896975:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408487296 00000100:00100000:1.0:1789181589.896996:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408487296 00000100:00100000:1.0:1789181589.897535:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789181589.897546:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408487296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181589.897827:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408487296:12345-0@lo:502:mount.lustre.0 Request processed in 281us (4497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181589.897835:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789181589.900553:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408487296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789181589.900870:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789181589.900896:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789181589.900940:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408487424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181589.901431:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181589.901478:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408487424 00000100:00100000:0.0:1789181589.901484:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408487424 00000100:00100000:0.0:1789181589.901534:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789181589.901542:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408487424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181589.901660:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408487424:12345-0@lo:502:mount.lustre.0 Request processed in 118us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181589.901668:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789181589.901808:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181589.901826:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408487424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789181589.901878:0:18646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789181589.901888:0:18646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789181589.902947:0:18672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789181589.902965:0:18672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c1dc4e00000) 00000020:00000080:0.0:1789181589.902990:0:18672:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789181589.903249:0:18672:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1df3d93800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789181589.903254:0:18672:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1df3d93800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789181589.903256:0:18672:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1df3d93800 3 00010000:00080000:0.0:1789181589.903287:0:18672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1df27e8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1789181589.909173:0:18672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789181589.910132:0:18672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789181589.910185:0:18672:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789181589.910200:0:18672:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x76fb555283518344 00000100:00080000:1.0:1789181589.910213:0:18672:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181589.910225:0:18672:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c1df27e8800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181589.910274:0:18672:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f07480 x1876092408487552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789181589.910307:0:18672:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789181589.910349:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181589.910354:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181589.910357:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181589.910360:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181589.910395:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181589.910398:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181589.910401:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181589.910404:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789181589.910435:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408488064:0@lo:400:kworker.0 00000100:00100000:1.0:1789181589.910496:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.910530:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181589.910535:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408487680:0@lo:400:kworker.0 00000100:00100000:1.0:1789181589.910559:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.910590:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408488064 00000100:00100000:1.0:1789181589.910597:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408488064 00000100:00100000:1.0:1789181589.910645:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789181589.910654:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408488064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181589.910704:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408488064:12345-0@lo:400:kworker.0 Request processed in 51us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181589.910711:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789181589.910859:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1dc2f05c00 x1876092408488064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181589.910873:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408488064:0@lo:400:kworker.0 00000100:00100000:2.0:1789181589.911117:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876092408487552:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789181589.911153:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181589.911200:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408487808:0@lo:400:kworker.0 00000100:00100000:2.0:1789181589.911222:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181589.911237:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181589.911243:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408487936:0@lo:400:kworker.0 00000100:00100000:2.0:1789181589.911261:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181589.911286:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408487680 00000100:00100000:2.0:1789181589.911290:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408487680 00000100:00100000:2.0:1789181589.911316:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408487936 00000100:00100000:2.0:1789181589.911319:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408487936 00000100:00100000:2.0:1789181589.911331:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181589.911337:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408487680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181589.911390:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408487680:12345-0@lo:400:kworker.0 Request processed in 53us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181589.911396:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181589.911408:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181589.911414:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408487936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181589.911452:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408487936:12345-0@lo:400:kworker.0 Request processed in 37us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181589.911458:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181589.911472:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408487552 00000100:00100000:2.0:1789181589.911476:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408487552 00000100:00100000:2.0:1789181589.911486:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408487808 00000100:00100000:2.0:1789181589.911488:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408487808 00000100:00100000:2.0:1789181589.911500:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181589.911506:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408487808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181589.911531:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408487808:12345-0@lo:400:kworker.0 Request processed in 24us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181589.911536:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181589.911546:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181589.911550:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876092408487552:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789181589.911571:0:17146:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1789181589.911614:0:17146:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x76fb55528351834b 00000004:00100000:2.0:1789181589.911628:0:17146:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789181589.911660:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9c1e00d27000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181589.911695:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876092408487552:12345-0@lo:38:llog_process_th.0 Request processed in 144us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181589.911702:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181589.911769:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408487680:0@lo:400:kworker.0 00010000:00080000:2.0:1789181589.911796:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1dc2f07480 x1876092408487552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181589.911805:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789181589.911817:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789181589.911825:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789181589.911830:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789181589.911832:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1df27e8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789181589.911838:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1876092408487552:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789181589.911862:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408487936:0@lo:400:kworker.0 00010000:00080000:2.0:1789181589.911872:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1dc2f06300 x1876092408487808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181589.911880:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408487808:0@lo:400:kworker.0 00000020:01000004:1.0:1789181589.921926:0:18672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789181589.921947:0:18672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c1dd9304d40) 00000020:00000080:1.0:1789181589.921976:0:18672:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789181589.922915:0:18672:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1df3d93800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789181589.922923:0:18672:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1df3d93800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789181589.922925:0:18672:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1df3d93800 3 00010000:00080000:1.0:1789181589.922956:0:18672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1dfb993800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:1.0:1789181589.928241:0:18672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789181589.929575:0:18672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789181589.929644:0:18672:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789181589.929656:0:18672:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x76fb555283518359 00000100:00080000:1.0:1789181589.929667:0:18672:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181589.929679:0:18672:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c1dfb993800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181589.929716:0:18672:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc2f05c00 x1876092408488192/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789181589.930849:0:18672:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789181589.930873:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181589.930878:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181589.930881:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181589.930884:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181589.930887:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181589.930890:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181589.930900:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181589.930903:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789181589.931511:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876092408488192:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789181589.931584:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181589.932196:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408488192 00000100:00100000:1.0:1789181589.932207:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408488192 00000100:00100000:1.0:1789181589.932251:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181589.932259:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1876092408488192:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789181589.932289:0:17146:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:1.0:1789181589.932334:0:17146:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x76fb555283518360 00000004:00100000:1.0:1789181589.932354:0:17146:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789181589.932885:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9c1cc45bc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181589.932975:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876092408488192:12345-0@lo:38:llog_process_th.0 Request processed in 714us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181589.932984:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789181589.933234:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c1dc2f05c00 x1876092408488192/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181589.933246:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181589.933255:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789181589.933263:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789181589.933268:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789181589.933271:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1dfb993800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789181589.933276:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1876092408488192:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789181589.933906:0:18672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789181589.934212:0:18646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789181589.934243:0:18646:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789181589.934264:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb55528351832f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518336 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.934276:0:18646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13a00/0x76fb55528351832f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518336 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789181589.934331:0:18646:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789181589.934334:0:18646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181589.934335:0:18646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181589.934337:0:18646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181589.934338:0:18646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181589.934340:0:18646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181589.934342:0:18646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181589.934344:0:18646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181589.934346:0:18646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789181589.934351:0:18646:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789181589.934353:0:18646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789181589.934355:0:18646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181589.934356:0:18646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181589.934357:0:18646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181589.934358:0:18646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181589.934359:0:18646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181589.934360:0:18646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181589.934371:0:18646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181589.934373:0:18646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789181589.934398:0:18646:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789181589.934419:0:18646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408488320:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789181589.934483:0:18646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181589.934525:0:18646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181589.934841:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408488320 00000100:00100000:0.0:1789181589.934849:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408488320 00000100:00100000:0.0:1789181589.934891:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789181589.934901:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408488320:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789181589.934927:0:17140:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789181589.934941:0:17140:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789181589.946537:0:17140:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789181589.946587:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789181589.947166:0:17161:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789181589.947172:0:17161:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789181589.947197:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.947227:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0084ae00/0x76fb5552835182b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835182aa expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.947235:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0084b000/0x76fb5552835182bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835182b8 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.947242:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.947281:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0084b000/0x76fb5552835182bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb5552835182b8 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.947296:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0084b000/0x76fb5552835182bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb5552835182b8 expref: 21 pid: 17140 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181589.947309:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408488448:0@lo:104: 00000100:00100000:0.0:1789181589.947718:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:18646:x1876092408488320:12345-0@lo:253:mount.lustre.0 Request processed in 12817us (13232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181589.947757:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789181589.947941:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181589.947997:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0084ae00/0x76fb5552835182b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb5552835182aa expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948017:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0084ae00/0x76fb5552835182b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb5552835182aa expref: 20 pid: 17138 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181589.948026:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408488576:0@lo:104: 00000100:00100000:3.0:1789181589.948056:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181589.948074:0:17161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181589.948097:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789181589.948112:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408488448 00000100:00100000:3.0:1789181589.948118:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408488448 00000100:00100000:3.0:1789181589.948156:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408488576 00000100:00100000:3.0:1789181589.948159:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408488576 00000100:00100000:3.0:1789181589.948172:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181589.948179:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+4:17161:x1876092408488448:12345-0@lo:104: 00010000:00010000:3.0:1789181589.948191:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948235:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181589.948240:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+4:17161:x1876092408488448:12345-0@lo:104: Request processed in 63us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181589.948245:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181589.948258:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181589.948263:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc379a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+3:17161:x1876092408488576:12345-0@lo:104: 00010000:00010000:3.0:1789181589.948269:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948298:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789181589.948303:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc379a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+3:17161:x1876092408488576:12345-0@lo:104: Request processed in 40us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181589.948308:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789181589.948344:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181589.948350:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948357:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12000 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181589.948374:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948384:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181589.948397:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181589.948403:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181589.948431:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948437:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181589.948456:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948465:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12000/0x76fb5552835182b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182bf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948479:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181589.948482:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948487:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1800 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:3.0:1789181589.948490:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948496:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181589.948502:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181589.948507:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181589.948526:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948532:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181589.948546:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948553:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1cc39f1800/0x76fb5552835182aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182b1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.948565:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181589.948567:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181589.948569:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181589.948575:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181589.948591:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408488704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181589.948630:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181589.948663:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408488832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181589.948688:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181589.948981:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408488704 00000100:00100000:3.0:1789181589.948987:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408488704 00010000:00010000:3.0:1789181589.949066:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0084b000/0x76fb5552835182bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835182b8 expref: 21 pid: 17140 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181589.949185:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408488832 00000100:00100000:3.0:1789181589.949190:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408488832 00010000:00010000:3.0:1789181589.949205:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0084ae00/0x76fb5552835182b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835182aa expref: 22 pid: 17138 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181589.949281:0:18646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:18646:1876092408488320:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789181589.949293:0:18646:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789181589.949297:0:18646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789181589.949298:0:18646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789181589.949300:0:18646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181589.949301:0:18646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181589.949302:0:18646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181589.949303:0:18646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181589.949305:0:18646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789181589.949307:0:18646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181589.949308:0:18646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789181589.949323:0:18646:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789181589.951239:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181589.951257:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:868df35c-3970-416b-9e25-2e3d68c8633a+22:3646:x1876092408488704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181589.951278:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181589.951288:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0084b000/0x76fb5552835182bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835182b8 expref: 22 pid: 17140 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181589.951303:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0084b000/0x76fb5552835182bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb5552835182b8 expref: 22 pid: 17140 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181589.951327:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181589.951507:0:17131:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789181589.951518:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789181589.951687:0:17132:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789181589.951711:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181589.952089:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff941c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:868df35c-3970-416b-9e25-2e3d68c8633a+22:3643:x1876092408488832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181589.952103:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181589.952111:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0084ae00/0x76fb5552835182b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835182aa expref: 22 pid: 17138 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952121:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0084ae00/0x76fb5552835182b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb5552835182aa expref: 22 pid: 17138 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952136:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952146:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789181589.952162:0:17132:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012608336s 00010000:00010000:3.0:1789181589.952167:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952174:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952183:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952190:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952197:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fc00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181589.952202:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952221:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952230:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952242:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181589.952401:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:868df35c-3970-416b-9e25-2e3d68c8633a+22:3646:x1876092408488704:12345-0@lo:103:ldlm_bl.0 Request processed in 1148us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181589.952411:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181589.952501:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff941c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:868df35c-3970-416b-9e25-2e3d68c8633a+21:3643:x1876092408488832:12345-0@lo:103:ldlm_bl.0 Request processed in 782us (3811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181589.952508:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789181589.952578:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0084b000/0x76fb5552835182bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb5552835182b8 expref: 20 pid: 17140 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181589.952590:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408488448:0@lo:104: 00010000:00010000:3.0:1789181589.952611:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0084ae00/0x76fb5552835182b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb5552835182aa expref: 19 pid: 17138 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181589.952619:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408488576:0@lo:104: 00010000:00010000:3.0:1789181589.952639:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952649:0:17161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952654:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181589.952660:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085fc00/0x76fb555283518367 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181589.954965:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408488704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181589.957576:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408488832:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1789181589.959267:0:18646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789181589.961953:0:18646:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789181589.961964:0:18646:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789181589.962082:0:18646:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789181589.962132:0:18646:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789181589.962152:0:18646:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789181589.962176:0:18646:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789181589.964524:0:18646:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789181589.965910:0:18646:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789181590.033181:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181590.416405:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1789181590.885982:0:18726:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789181590.886247:0:18726:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789181591.055021:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789181591.376160:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789181591.376171:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1dc6df7800 from 9 10000000:01000000:2.0:1789181591.376188:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789181591.376261:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181591.376278:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181591.376293:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181591.376328:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408488960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181591.377003:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181591.377072:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd132ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181591.378815:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408488960 00000100:00100000:0.0:1789181591.378829:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408488960 00000100:00100000:0.0:1789181591.378899:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789181591.378910:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+19:17142:x1876092408488960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181591.378928:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181591.378952:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f0600/0x76fb555283518375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351836e expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.378985:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f0600/0x76fb555283518375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351836e expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.378997:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f0600/0x76fb555283518375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351836e expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.379007:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f0600, rc 0) 00000100:00100000:0.0:1789181591.379112:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+20:17142:x1876092408488960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181591.379119:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789181591.379291:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408488960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181591.379312:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181591.379323:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181591.379398:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408489088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789181591.379442:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181591.379937:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd132ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181591.382949:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408489088 00000100:00100000:0.0:1789181591.382968:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408489088 00000100:00100000:0.0:1789181591.383036:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789181591.383048:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+20:17142:x1876092408489088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789181591.383217:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789181591.383238:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789181591.383242:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789181591.383458:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+20:17142:x1876092408489088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 412us (4015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181591.383471:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789181591.383641:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408489088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789181591.383759:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789181591.383769:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.383778:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181591.383788:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789181591.383791:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1cc44fb800 from 9 10000000:01000000:3.0:1789181591.383794:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789181591.383829:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.383837:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.383846:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181591.383867:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408489216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789181591.383907:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181591.383943:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de18360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181591.384178:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408489216 00000100:00100000:0.0:1789181591.384184:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408489216 00000100:00100000:0.0:1789181591.384228:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789181591.384237:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+20:17142:x1876092408489216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181591.384246:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181591.384259:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f1400/0x76fb555283518383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351837c expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.384282:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f1400/0x76fb555283518383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351837c expref: 21 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.384293:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f1400/0x76fb555283518383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351837c expref: 21 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.384301:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1400, rc 0) 00000100:00100000:0.0:1789181591.384345:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+21:17142:x1876092408489216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181591.384465:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789181591.384540:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408489216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181591.384566:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.384575:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181591.384635:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408489344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789181591.384668:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181591.384690:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de18360c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181591.384752:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408489344 00000100:00100000:1.0:1789181591.384757:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408489344 00000100:00100000:1.0:1789181591.384790:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789181591.384799:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:17142:x1876092408489344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789181591.384812:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789181591.384827:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789181591.384830:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789181591.384910:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:17142:x1876092408489344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181591.384917:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789181591.385236:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408489344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789181591.385296:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789181591.385302:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.385310:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181592.077020:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181593.100073:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181593.371486:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408489472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181593.371583:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181593.371664:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408489472 00000100:00100000:0.0:1789181593.371672:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408489472 00000100:00100000:0.0:1789181593.371717:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789181593.371745:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408489472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181593.371786:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789181593.371860:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408489472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181593.371868:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789181593.371945:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408489472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181593.371990:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408489600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181593.372022:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181593.372346:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408489600 00000100:00100000:1.0:1789181593.372351:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408489600 00000100:00100000:1.0:1789181593.372386:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789181593.372395:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408489600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789181593.373434:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789181593.373515:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408489600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1120us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181593.373524:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181593.373640:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408489600:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789181594.126436:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181594.188415:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789181595.157453:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181595.404099:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181595.404106:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181595.404109:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181595.404112:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181595.404128:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181595.404131:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181595.404162:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181595.404165:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789181595.404212:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408490112:0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.404280:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181595.404325:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789181595.404331:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408489728:0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.404361:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181595.404403:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408490240:0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.404427:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181595.404468:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408489856:0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.404495:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181595.404513:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408490368:0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.404535:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181595.404563:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789181595.404569:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408489984:0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.404590:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181595.404608:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408490496:0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.404629:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181595.404663:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408490112 00000100:00100000:1.0:1789181595.404672:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408490112 00000100:00100000:1.0:1789181595.404717:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408489856 00000100:00100000:1.0:1789181595.404720:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408489856 00000100:00100000:1.0:1789181595.404761:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789181595.404770:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408490112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.404831:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408490112:12345-0@lo:400:kworker.0 Request processed in 61us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181595.404845:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789181595.404864:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789181595.404871:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408489856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.404905:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408489856:12345-0@lo:400:kworker.0 Request processed in 36us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181595.404911:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789181595.404931:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408489728 00000100:00100000:1.0:1789181595.404934:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408489728 00000100:00100000:1.0:1789181595.404960:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789181595.404966:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+21:3645:x1876092408489728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.404994:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+21:3645:x1876092408489728:12345-0@lo:400:kworker.0 Request processed in 29us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181595.404999:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789181595.405027:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408490240 00000100:00100000:1.0:1789181595.405031:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408490240 00000100:00100000:1.0:1789181595.405048:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408490368 00000100:00100000:1.0:1789181595.405050:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408490368 00000100:00100000:1.0:1789181595.405077:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408489984 00000100:00100000:1.0:1789181595.405080:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408489984 00000100:00100000:1.0:1789181595.405090:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408490496 00000100:00100000:1.0:1789181595.405092:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408490496 00000100:00100000:1.0:1789181595.405106:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181595.405112:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408490240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.405141:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408490240:12345-0@lo:400:kworker.0 Request processed in 30us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181595.405147:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181595.405158:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181595.405171:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408490368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.405214:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408490368:12345-0@lo:400:kworker.0 Request processed in 44us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181595.405220:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181595.405230:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181595.405235:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408489984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.405258:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408489984:12345-0@lo:400:kworker.0 Request processed in 23us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181595.405263:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181595.405273:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181595.405278:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408490496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.405300:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408490496:12345-0@lo:400:kworker.0 Request processed in 22us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181595.405305:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789181595.405355:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc2f05880 x1876092408489984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181595.405370:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408489984:0@lo:400:kworker.0 00010000:00080000:1.0:1789181595.405380:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc2f06a00 x1876092408490496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181595.405388:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408490496:0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.405400:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408489856:0@lo:400:kworker.0 00010000:00080000:1.0:1789181595.405409:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc2f06300 x1876092408490368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181595.405429:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408490368:0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.405457:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408489728:0@lo:400:kworker.0 00010000:00080000:1.0:1789181595.405466:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc2f05c00 x1876092408490240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181595.405472:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408490240:0@lo:400:kworker.0 00000100:00100000:1.0:1789181595.405480:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408490112:0@lo:400:kworker.0 00000100:00080000:0.0:1789181595.406375:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789181595.406392:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789181596.171903:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181597.132253:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181582/real 1789181582] req@ffff9c1cc3ba6300 x1876092408482304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181597 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181597.132291:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1cc3ba6300 x1876092408482304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181597 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181597.132300:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181582/real 1789181582] req@ffff9c1cc3ba6d80 x1876092408482176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181597 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181597.132312:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1cc3ba6d80 x1876092408482176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181597 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789181597.132333:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789181597.132350:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789181597.132354:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408482304:0@lo:8:kworker.0 00000100:00080000:1.0:1789181597.132360:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7d92000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789181597.132365:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789181597.132368:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408482176:0@lo:8:kworker.0 00000100:00080000:1.0:1789181597.132465:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181597.132482:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181597.132485:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181597.132488:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181597.132531:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181597.132534:0:126:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789181597.132546:0:126:0:(import.c:65:import_set_state_nolock()) ffff9c1de7d92000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181597.132551:0:126:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 538 00000100:00080000:1.0:1789181597.132556:0:126:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789181597.132565:0:126:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c1de7d92000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181597.132585:0:126:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1de7cbf100 x1876092408491136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789181597.132597:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181597.132600:0:126:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789181597.132602:0:126:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181597.132604:0:126:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 538 00000100:00080000:1.0:1789181597.132607:0:126:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789181597.132611:0:126:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c1cc1dcc000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181597.132620:0:126:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1de7cbc000 x1876092408491264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181597.132660:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408490624:0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.132745:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181597.132785:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408491392:0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.132810:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181597.132812:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408490752:0@lo:400:kworker.0 00000100:00100000:0.0:1789181597.132842:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181597.132847:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408491008:0@lo:400:kworker.0 00000100:00100000:0.0:1789181597.132861:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408491520:0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.132882:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181597.132887:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181597.132901:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789181597.132906:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408490880:0@lo:400:kworker.0 00000100:00100000:0.0:1789181597.132916:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408490624 00000100:00100000:0.0:1789181597.132924:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408490624 00000100:00100000:1.0:1789181597.132925:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181597.132939:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408491648:0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.132959:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181597.132967:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789181597.132975:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:3645:x1876092408490624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.132976:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408491392 00000100:00100000:1.0:1789181597.132979:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408491392 00000100:00100000:1.0:1789181597.132998:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408491520 00000100:00100000:1.0:1789181597.133000:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408491520 00000100:00100000:0.0:1789181597.133023:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:3645:x1876092408490624:12345-0@lo:400:kworker.0 Request processed in 49us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181597.133030:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789181597.133035:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408490880 00000100:00100000:1.0:1789181597.133038:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408490880 00000100:00100000:1.0:1789181597.133046:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408491648 00000100:00100000:1.0:1789181597.133048:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408491648 00000100:00100000:1.0:1789181597.133060:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789181597.133065:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408491392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181597.133073:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408490752 00000100:00100000:0.0:1789181597.133077:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408490752 00000100:00100000:1.0:1789181597.133095:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408491392:12345-0@lo:400:kworker.0 Request processed in 30us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181597.133097:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408491008 00000100:00100000:0.0:1789181597.133100:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408491008 00000100:00100000:1.0:1789181597.133101:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789181597.133111:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789181597.133111:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789181597.133116:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408491520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181597.133129:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408490752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.133146:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408491520:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181597.133151:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789181597.133156:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408490752:12345-0@lo:400:kworker.0 Request processed in 28us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181597.133162:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789181597.133166:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408490880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181597.133167:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789181597.133177:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789181597.133182:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408491008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.133201:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408490880:12345-0@lo:400:kworker.0 Request processed in 35us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181597.133205:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408491008:12345-0@lo:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181597.133207:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181597.133210:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789181597.133217:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181597.133222:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408491648:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789181597.133229:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789181597.133233:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181597.133244:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408491648:12345-0@lo:400:kworker.0 Request processed in 23us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181597.133249:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789181597.133259:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408490752:0@lo:400:kworker.0 00010000:00080000:0.0:1789181597.133269:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbd500 x1876092408491520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789181597.133274:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbdf80 x1876092408490880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181597.133278:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408491520:0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.133282:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408490880:0@lo:400:kworker.0 00010000:00080000:1.0:1789181597.133291:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbd180 x1876092408491648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181597.133299:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408491648:0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.133307:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408491008:0@lo:400:kworker.0 00000100:00100000:0.0:1789181597.133310:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408490624:0@lo:400:kworker.0 00010000:00080000:0.0:1789181597.133320:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbfb80 x1876092408491392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181597.133324:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408491136:0@lo:8:kworker.0 00000100:00100000:0.0:1789181597.133328:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408491392:0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.133348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181597.133370:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408491264:0@lo:8:kworker.0 00000100:00100000:0.0:1789181597.133384:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408491136 00000100:00100000:0.0:1789181597.133388:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408491136 00000100:00100000:1.0:1789181597.133391:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181597.133404:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408491264 00000100:00100000:0.0:1789181597.133407:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408491264 00000100:00100000:0.0:1789181597.133415:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181597.133418:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789181597.133419:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408491136:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789181597.133425:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1789181597.133444:0:18650:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:0.0:1789181597.133472:0:18650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb55528351838a 00002000:00100000:0.0:1789181597.133492:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c1df27ea000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789181597.133496:0:18650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1789181597.133499:0:18650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789181597.133706:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789181597.133765:0:18650:0:(import.c:65:import_set_state_nolock()) ffff9c1df27eb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181597.133804:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1876092408491136:12345-0@lo:8:kworker.0 Request processed in 382us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181597.133810:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181597.133823:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181597.133827:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408491264:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789181597.133834:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbf100 x1876092408491136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:0.0:1789181597.133838:0:18650:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789181597.133841:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789181597.133853:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789181597.133860:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789181597.133864:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789181597.133867:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7d92000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789181597.133889:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789181597.133895:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408491136:0@lo:8:kworker.0 00000004:00080000:1.0:1789181597.133918:0:17885:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789181597.133974:0:17885:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 553121250269ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789181597.133981:0:17885:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789181597.134220:0:17886:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789181597.134242:0:17886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876092408491904:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789181597.134280:0:17886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181597.134292:0:17886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc68873c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181597.134302:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181597.134310:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408491776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181597.134333:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789181597.135672:0:17877:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789181597.143932:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408491776 00000100:00100000:1.0:1789181597.143948:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408491776 00000100:00100000:1.0:1789181597.144022:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181597.144033:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1876092408491776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789181597.144075:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789181597.144164:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1876092408491776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (9830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181597.144172:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789181597.144225:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc3849880 x1876092408491776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181597.144248:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408491776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181597.147956:0:18653:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789181597.147984:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408491904 00000100:00100000:3.0:1789181597.147994:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408491904 00000100:00100000:3.0:1789181597.148334:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181597.148344:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17886:x1876092408491904:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1789181597.168748:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181597.168864:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408491264:12345-0@lo:8:kworker.0 Request processed in 35029us (35465us total) trans 0 rc -19/-19 00000100:00080000:2.0:1789181597.169000:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789181597.169007:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789181597.169011:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408491264:0@lo:8:kworker.0 00000100:00100000:0.0:1789181597.171013:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:0.0:1789181597.172914:0:18978:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789181597.172924:0:18978:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789181597.173025:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17886:x1876092408491904:12345-0@lo:7:osp-pre-0-1.0 Request processed in 24679us (38741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181597.173037:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789181597.173057:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc384a680 x1876092408491904/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789181613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181597.173089:0:17886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876092408491904:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789181597.173105:0:17886:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789181597.173158:0:17886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876092408492032:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789181597.173197:0:17886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181597.173231:0:17886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb3746c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181597.175359:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408492032 00000100:00100000:0.0:1789181597.175376:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408492032 00000100:00100000:0.0:1789181597.175448:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181597.175459:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17886:x1876092408492032:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789181597.175496:0:18653:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789181597.175589:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17886:x1876092408492032:12345-0@lo:5:osp-pre-0-1.0 Request processed in 132us (2391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181597.175606:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789181597.175609:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dff850700 x1876092408492032/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181597.175624:0:17886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876092408492032:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789181597.175641:0:17886:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789181597.175692:0:17886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876092408492160:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789181597.175749:0:17886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181597.175774:0:17886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb3746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181597.175794:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408492160 00000100:00100000:2.0:1789181597.175798:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408492160 00000100:00100000:2.0:1789181597.175824:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181597.175830:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17886:x1876092408492160:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789181597.175858:0:18652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1789181597.199753:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789181597.210318:0:18647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789181597.210336:0:18647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789181597.210643:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17886:x1876092408492160:12345-0@lo:5:osp-pre-0-1.0 Request processed in 34808us (34889us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789181597.210655:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789181597.211108:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dff850700 x1876092408492160/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181597.211122:0:17886:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789181597.211130:0:17886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17886:1876092408492160:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789181597.211171:0:17886:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1789181597.211224:0:17886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17886:1876092408492288:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789181597.211271:0:17886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181597.211352:0:17886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb3746c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181597.216177:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408492288 00000100:00100000:3.0:1789181597.216197:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408492288 00000100:00100000:3.0:1789181597.216260:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181597.216271:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17886:x1876092408492288:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789181597.216382:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17886:x1876092408492288:12345-0@lo:900:osp-pre-0-1.0 Request processed in 113us (5110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181597.216389:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789181597.216436:0:17886:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dff850700 x1876092408492288/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789181613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181597.216450:0:17886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17886:1876092408492288:0@lo:900:osp-pre-0-1.0 00000001:02000400:1.0:1789181597.609598:0:19017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789181598.220432:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181598.476769:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408492544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181598.476855:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181598.476898:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181598.476904:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408492416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181598.476926:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181598.476971:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408492544 00000100:00100000:0.0:1789181598.476980:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408492544 00000100:00100000:0.0:1789181598.477024:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408492416 00000100:00100000:0.0:1789181598.477028:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408492416 00000100:00100000:0.0:1789181598.477042:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789181598.477051:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408492544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181598.477087:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789181598.477138:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408492544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181598.477145:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789181598.477163:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789181598.477169:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408492416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789181598.477186:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789181598.477211:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408492416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181598.477217:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789181598.477261:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408492416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181598.477272:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408492544:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1789181599.014369:0:19069:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789181599.018789:0:19069:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789181599.244419:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181600.271012:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789181600.348650:0:19120:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789181600.349192:0:19120:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789181600.652558:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789181601.292973:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181602.315914:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181602.576329:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408492672:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.576413:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181602.576502:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408492672 00000100:00100000:1.0:1789181602.576510:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408492672 00000100:00100000:1.0:1789181602.576559:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789181602.576567:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:3643:x1876092408492672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.576630:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:3643:x1876092408492672:12345-0@lo:400:kworker.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181602.576638:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789181602.576691:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408492672:0@lo:400:kworker.0 00000100:00080000:1.0:1789181602.576748:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181602.576752:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181602.576755:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181602.576758:0:126:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789181602.576767:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408492800:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.576794:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181602.576826:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408492800 00000100:00100000:1.0:1789181602.576830:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408492800 00000100:00100000:1.0:1789181602.576856:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181602.576862:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408492800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.576899:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408492800:12345-0@lo:400:kworker.0 Request processed in 38us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181602.576920:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181602.576948:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408492800:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.576991:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181602.576999:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408492928:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577027:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181602.577059:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408492928 00000100:00100000:1.0:1789181602.577062:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408492928 00000100:00100000:1.0:1789181602.577086:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181602.577092:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408492928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577125:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408492928:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181602.577131:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789181602.577161:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbdf80 x1876092408492928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181602.577172:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408492928:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577200:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408493056:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577223:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181602.577249:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408493056 00000100:00100000:1.0:1789181602.577253:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408493056 00000100:00100000:1.0:1789181602.577274:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181602.577279:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408493056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577312:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408493056:12345-0@lo:400:kworker.0 Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181602.577317:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181602.577340:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408493056:0@lo:400:kworker.0 00000100:00080000:1.0:1789181602.577371:0:126:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181602.577374:0:126:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789181602.577378:0:126:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181602.577382:0:126:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:1.0:1789181602.577386:0:126:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789181602.577394:0:126:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c1cc1dcc000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1789181602.577401:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408493184:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577428:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181602.577458:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408493184 00000100:00100000:1.0:1789181602.577462:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408493184 00000100:00100000:1.0:1789181602.577517:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181602.577524:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408493184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577561:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408493184:12345-0@lo:400:kworker.0 Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181602.577567:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789181602.577584:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789181602.577603:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbdf80 x1876092408493184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181602.577612:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408493184:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577641:0:126:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1de7cbdf80 x1876092408493312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181602.577671:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408493440:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577695:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181602.577720:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408493440 00000100:00100000:1.0:1789181602.577744:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408493440 00000100:00100000:1.0:1789181602.577773:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789181602.577779:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408493440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577812:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876092408493440:12345-0@lo:400:kworker.0 Request processed in 34us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181602.577817:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789181602.577842:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbe680 x1876092408493440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181602.577850:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876092408493440:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577877:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181602.577882:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408493568:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577902:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181602.577922:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408493568 00000100:00100000:1.0:1789181602.577926:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408493568 00000100:00100000:1.0:1789181602.577949:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181602.577954:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408493568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.577986:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408493568:12345-0@lo:400:kworker.0 Request processed in 32us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181602.577992:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789181602.578004:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789181602.578020:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbe680 x1876092408493568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181602.578029:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408493568:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.578055:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408493696:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.578074:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181602.578093:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408493696 00000100:00100000:1.0:1789181602.578102:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408493696 00000100:00100000:1.0:1789181602.578125:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181602.578130:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408493696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.578157:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408493696:12345-0@lo:400:kworker.0 Request processed in 27us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181602.578162:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789181602.578173:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789181602.578187:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1de7cbe680 x1876092408493696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181602.578195:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408493696:0@lo:400:kworker.0 00000100:00100000:1.0:1789181602.582498:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181602.582524:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408493824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181602.582597:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181602.582796:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408493824 00000100:00100000:3.0:1789181602.582804:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408493824 00000100:00100000:3.0:1789181602.582856:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181602.582865:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408493824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181602.582902:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789181602.583107:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408493824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 242us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181602.583115:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789181602.583180:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc3848000 x1876092408493824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181602.583199:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408493824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789181602.583812:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408493312:0@lo:8:kworker.0 00000100:00100000:2.0:1789181602.584353:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181602.584955:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408493312 00000100:00100000:1.0:1789181602.584964:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408493312 00000100:00100000:1.0:1789181602.585005:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789181602.585012:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408493312:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789181602.585035:0:18650:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789181602.608285:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408493312:12345-0@lo:8:kworker.0 Request processed in 23263us (23923us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789181602.608300:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789181602.608519:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181602.608526:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789181602.608530:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408493312:0@lo:8:kworker.0 00010000:00010000:1.0:1789181603.343000:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181603.595966:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181583/real 1789181583] req@ffff9c1cc3ba4000 x1876092408483712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181603.595995:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1cc3ba4000 x1876092408483712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181603.596005:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181583/real 1789181583] req@ffff9c1cc3ba7480 x1876092408483840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181603.596016:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c1cc3ba7480 x1876092408483840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789181603.596034:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f49000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181603.596048:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789181603.596051:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408483712:0@lo:8:kworker.0 00000100:00080000:0.0:1789181603.596068:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181603.596074:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789181603.596077:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408483840:0@lo:8:kworker.0 00000100:00100000:0.0:1789181603.596107:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408493952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181603.596169:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789181603.596245:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181603.596248:0:253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789181603.596258:0:253:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f49000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181603.596262:0:253:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:0.0:1789181603.596268:0:253:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789181603.596279:0:253:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c1de7f49000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181603.596300:0:253:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3ba5500 x1876092408494336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181603.596312:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181603.596315:0:253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789181603.596317:0:253:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181603.596320:0:253:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:0.0:1789181603.596322:0:253:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789181603.596326:0:253:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c1cc1d28000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181603.596336:0:253:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3ba4700 x1876092408494464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181603.596361:0:253:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789181603.596365:0:253:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789181603.596366:0:253:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181603.596369:0:253:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 558 00000100:00080000:0.0:1789181603.596372:0:253:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789181603.596376:0:253:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c1cc1dcc000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1789181603.596387:0:253:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc4dea300 x1876092408494848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789181603.596428:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408493952 00000100:00100000:0.0:1789181603.596435:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408493952 00000100:00100000:0.0:1789181603.596523:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181603.596540:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408493952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181603.596573:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789181603.596615:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408493952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181603.596622:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181603.596649:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408494080:0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.596678:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.596717:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408494976:0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.596773:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.596794:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789181603.596799:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408494208:0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.596817:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.596833:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408495104:0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.596851:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.596877:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408494208 00000100:00100000:0.0:1789181603.596882:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408494208 00000100:00100000:0.0:1789181603.596906:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789181603.596912:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408494208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.596947:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408494208:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181603.596953:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789181603.596970:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408494080 00000100:00100000:0.0:1789181603.596974:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408494080 00000100:00100000:0.0:1789181603.596998:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789181603.597005:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+21:3645:x1876092408494080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.597033:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+21:3645:x1876092408494080:12345-0@lo:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181603.597046:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789181603.597076:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408494976 00000100:00100000:0.0:1789181603.597080:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408494976 00000100:00100000:0.0:1789181603.597104:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408495104 00000100:00100000:0.0:1789181603.597107:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408495104 00000100:00100000:0.0:1789181603.597121:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789181603.597127:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408494976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.597157:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408494976:12345-0@lo:400:kworker.0 Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181603.597162:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789181603.597174:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181603.597180:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408495104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.601474:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408495104:12345-0@lo:400:kworker.0 Request processed in 4282us (4609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181603.601497:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181603.601568:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408494592:0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.601605:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.601644:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408495232:0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.601697:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.601746:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789181603.601754:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408494720:0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.601782:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.601802:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408495360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181603.601824:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.601855:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408494720 00000100:00100000:0.0:1789181603.601870:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408494720 00000100:00100000:0.0:1789181603.601915:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181603.601936:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408494720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.601980:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408494720:12345-0@lo:400:kworker.0 Request processed in 46us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181603.601986:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181603.602009:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408494592 00000100:00100000:0.0:1789181603.602012:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408494592 00000100:00100000:0.0:1789181603.602034:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408495232 00000100:00100000:0.0:1789181603.602037:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408495232 00000100:00100000:0.0:1789181603.602051:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789181603.602718:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408494592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.602825:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408494592:12345-0@lo:400:kworker.0 Request processed in 766us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181603.602833:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789181603.602853:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789181603.602861:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408495232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.602891:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408495232:12345-0@lo:400:kworker.0 Request processed in 31us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181603.602896:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789181603.602933:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408495360 00000100:00100000:0.0:1789181603.602938:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408495360 00000100:00100000:0.0:1789181603.602968:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789181603.602975:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408495360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789181603.603000:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789181603.603032:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408495360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181603.603052:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789181603.603416:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408493952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789181603.603452:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408494336:0@lo:8:kworker.0 00000100:00100000:0.0:1789181603.603500:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.603538:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408494464:0@lo:8:kworker.0 00000100:00100000:0.0:1789181603.603561:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.603587:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408494848:0@lo:8:kworker.0 00000100:00100000:0.0:1789181603.603607:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181603.603637:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408494336 00000100:00100000:0.0:1789181603.603641:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408494336 00000100:00100000:0.0:1789181603.603659:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408494464 00000100:00100000:0.0:1789181603.603661:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408494464 00000100:00100000:0.0:1789181603.603667:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408494848 00000100:00100000:0.0:1789181603.603669:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408494848 00000100:00100000:0.0:1789181603.603679:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181603.603684:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876092408494336:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789181603.603712:0:18653:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:0.0:1789181603.603781:0:18653:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb555283518391 00002000:00100000:0.0:1789181603.603799:0:18653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c1df27ef000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789181603.603804:0:18653:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789181603.603808:0:18653:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789181603.603892:0:18653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789181603.604075:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181603.604083:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1876092408494464:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789181603.604097:0:18652:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789181603.604147:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1876092408494464:12345-0@lo:8:kworker.0 Request processed in 63us (583us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789181603.604154:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181603.604170:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789181603.604175:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1876092408494848:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789181603.604184:0:18652:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789181603.604209:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1876092408494848:12345-0@lo:8:kworker.0 Request processed in 32us (600us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789181603.604214:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789181603.604261:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789181603.604267:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789181603.604271:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408494464:0@lo:8:kworker.0 00000100:00080000:2.0:1789181603.604281:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789181603.604284:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789181603.604287:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408494848:0@lo:8:kworker.0 00000100:00080000:0.0:1789181603.604637:0:18653:0:(import.c:65:import_set_state_nolock()) ffff9c1df27ee000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181603.604859:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876092408494336:12345-0@lo:8:kworker.0 Request processed in 1172us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181603.604877:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181603.605363:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408494208:0@lo:400:kworker.0 00010000:00080000:0.0:1789181603.605384:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc4de9c00 x1876092408495104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181603.605396:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408495104:0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.605407:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408494080:0@lo:400:kworker.0 00010000:00080000:0.0:1789181603.605418:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc4de9880 x1876092408494976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181603.605425:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408494976:0@lo:400:kworker.0 00010000:00080000:0.0:1789181603.605496:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc4deb480 x1876092408494720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181603.605505:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408494720:0@lo:400:kworker.0 00000100:00100000:0.0:1789181603.605521:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408495360:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1789181603.605532:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc3ba7b80 x1876092408494592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181603.605539:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408494592:0@lo:400:kworker.0 00010000:00080000:0.0:1789181603.605550:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc4de9500 x1876092408495232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181603.605556:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408495232:0@lo:400:kworker.0 00010000:00080000:2.0:1789181603.608404:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc3ba5500 x1876092408494336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181603.608422:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789181603.608433:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789181603.608443:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789181603.608449:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789181603.608453:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1de7f49000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789181603.608490:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789181603.608498:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408494336:0@lo:8:kworker.0 00000004:00080000:2.0:1789181603.608537:0:17169:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789181603.608643:0:17169:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559595919120ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789181603.608650:0:17169:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789181603.609498:0:17170:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789181603.609535:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17170:1876092408495616:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789181603.609608:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181603.609643:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc453c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181603.609660:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181603.609671:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408495488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181603.609707:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181603.609766:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408495488 00000100:00100000:1.0:1789181603.609773:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408495488 00000100:00100000:1.0:1789181603.609838:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789181603.609848:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408495488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181603.609874:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789181603.609917:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876092408495488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181603.609924:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789181603.609945:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789181603.609973:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dc2f04e00 x1876092408495488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181603.609991:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408495488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181603.610013:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408495616 00000100:00100000:1.0:1789181603.610016:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408495616 00000100:00100000:1.0:1789181603.610043:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181603.610049:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17170:x1876092408495616:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789181603.614052:0:17125:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789181603.617206:0:18652:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789181603.617223:0:18652:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789181603.617280:0:18652:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:2.0:1789181603.658317:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.658333:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283518398 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.658354:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.658359:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.658367:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283518398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.658388:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283518398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.658399:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283518398 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.658422:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283518398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.658453:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181603.659096:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.659111:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283518398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.659121:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.659126:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283518398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.659136:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283518398 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.659157:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283518398 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.659164:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa6e3e49/0x76fb555283518398 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.659187:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.659189:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.659191:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181603.659465:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.659471:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb55528351839f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.659492:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.659496:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.659500:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb55528351839f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.659509:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb55528351839f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.659516:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb55528351839f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.659524:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb55528351839f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.659544:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789181603.660011:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.660018:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835183a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.660033:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.660036:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.660040:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835183a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.660050:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835183a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.660069:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835183a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.660076:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835183a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.660090:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789181603.660442:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181603.660449:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb55528351839f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.660457:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a000 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.660460:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb55528351839f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.660496:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb55528351839f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.660509:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb55528351839f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.660516:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039978481/0x76fb55528351839f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.660532:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.660535:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835183a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.660541:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.660544:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835183a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.660551:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835183a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.660560:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835183a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.660566:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835183a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.660590:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.660592:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.660594:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.660601:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181603.660706:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.660712:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4db08e3/0x76fb5552835183ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.660760:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.660764:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.660769:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4db08e3/0x76fb5552835183ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.660778:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4db08e3/0x76fb5552835183ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.661015:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4db08e3/0x76fb5552835183ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.661023:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4db08e3/0x76fb5552835183ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.661044:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181603.661423:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.661430:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4db08e3/0x76fb5552835183ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.661439:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.661442:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4db08e3/0x76fb5552835183ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.661452:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4db08e3/0x76fb5552835183ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.661464:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4db08e3/0x76fb5552835183ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.661472:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4db08e3/0x76fb5552835183ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.661500:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.661502:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.661504:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181603.661615:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.661621:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb5552835183b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.661632:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.661636:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.661640:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb5552835183b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.661650:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb5552835183b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.661658:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb5552835183b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.661666:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb5552835183b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.661706:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181603.661990:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.661995:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb5552835183b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.662009:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b000 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.662013:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb5552835183b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.662021:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb5552835183b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.662032:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb5552835183b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.662039:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afdd14d0/0x76fb5552835183b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.662054:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.662067:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.662069:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181603.662403:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.662410:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835183bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.662421:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.662424:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.662428:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835183bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.662437:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835183bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.662446:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835183bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.662454:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835183bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.662514:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789181603.663936:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.663949:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077bdaec3/0x76fb5552835183c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.663964:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.663975:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.663981:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077bdaec3/0x76fb5552835183c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.663993:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077bdaec3/0x76fb5552835183c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.664004:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077bdaec3/0x76fb5552835183c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.664011:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077bdaec3/0x76fb5552835183c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.671976:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181603.671997:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835183bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.672013:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084ae00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.672019:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835183bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.672032:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835183bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.672207:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835183bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.672217:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c002b895/0x76fb5552835183bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.672319:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.672324:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077bdaec3/0x76fb5552835183c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.672332:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084bc00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.672335:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077bdaec3/0x76fb5552835183c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.672344:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077bdaec3/0x76fb5552835183c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.672355:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077bdaec3/0x76fb5552835183c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.672364:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.672365:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.672368:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181603.672926:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789181603.672935:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077bdaec3/0x76fb5552835183c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181603.673589:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.673597:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000504bb7bc/0x76fb5552835183c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.673610:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.673615:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.673620:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000504bb7bc/0x76fb5552835183c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.673633:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000504bb7bc/0x76fb5552835183c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.673650:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000504bb7bc/0x76fb5552835183c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.673658:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000504bb7bc/0x76fb5552835183c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.673674:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789181603.673963:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.673969:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004751d818/0x76fb5552835183d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.673978:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.673982:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.673986:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004751d818/0x76fb5552835183d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.673995:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004751d818/0x76fb5552835183d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674003:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004751d818/0x76fb5552835183d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674011:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004751d818/0x76fb5552835183d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674036:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789181603.674352:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.674358:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005358849a/0x76fb5552835183d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674368:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.674371:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.674376:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005358849a/0x76fb5552835183d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674385:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005358849a/0x76fb5552835183d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674393:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005358849a/0x76fb5552835183d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674401:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005358849a/0x76fb5552835183d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674408:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789181603.674704:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.674709:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088d1c633/0x76fb5552835183de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674717:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.674754:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.674759:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088d1c633/0x76fb5552835183de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674773:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088d1c633/0x76fb5552835183de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674781:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088d1c633/0x76fb5552835183de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674788:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088d1c633/0x76fb5552835183de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.674796:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789181603.675163:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789181603.675170:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000504bb7bc/0x76fb5552835183c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675189:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.675194:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000504bb7bc/0x76fb5552835183c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675203:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000504bb7bc/0x76fb5552835183c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675221:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000504bb7bc/0x76fb5552835183c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675229:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000504bb7bc/0x76fb5552835183c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675363:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789181603.675367:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004751d818/0x76fb5552835183d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675375:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.675378:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004751d818/0x76fb5552835183d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675385:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004751d818/0x76fb5552835183d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675396:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004751d818/0x76fb5552835183d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675408:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004751d818/0x76fb5552835183d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675421:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181603.675425:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005358849a/0x76fb5552835183d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675431:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0030c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.675436:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005358849a/0x76fb5552835183d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675443:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005358849a/0x76fb5552835183d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675454:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005358849a/0x76fb5552835183d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675460:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005358849a/0x76fb5552835183d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675472:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.675485:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088d1c633/0x76fb5552835183de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675491:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0030800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.675499:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088d1c633/0x76fb5552835183de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675507:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088d1c633/0x76fb5552835183de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675517:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088d1c633/0x76fb5552835183de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675524:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088d1c633/0x76fb5552835183de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.675537:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.675539:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.675541:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.675550:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.675554:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181603.675905:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.675913:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3bd9de3/0x76fb5552835183e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.675923:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.675927:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.675932:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3bd9de3/0x76fb5552835183e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.675943:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3bd9de3/0x76fb5552835183e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.675952:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3bd9de3/0x76fb5552835183e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.675966:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3bd9de3/0x76fb5552835183e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.675983:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181603.676144:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.676150:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3bd9de3/0x76fb5552835183e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.676158:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0031600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.676161:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3bd9de3/0x76fb5552835183e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.676170:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3bd9de3/0x76fb5552835183e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.676192:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3bd9de3/0x76fb5552835183e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.676199:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3bd9de3/0x76fb5552835183e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.676212:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.676213:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.676215:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181603.676541:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.676548:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ac9496/0x76fb5552835183ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.676556:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.676560:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.676564:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ac9496/0x76fb5552835183ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.676574:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038ac9496/0x76fb5552835183ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.676583:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ac9496/0x76fb5552835183ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.676591:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038ac9496/0x76fb5552835183ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.676637:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789181603.676941:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.676947:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006754cb47/0x76fb5552835183f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.676960:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.676963:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.676967:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006754cb47/0x76fb5552835183f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.676977:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006754cb47/0x76fb5552835183f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.676985:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006754cb47/0x76fb5552835183f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.676992:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006754cb47/0x76fb5552835183f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.683829:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181603.683849:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038ac9496/0x76fb5552835183ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.683865:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1523c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.683871:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ac9496/0x76fb5552835183ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.683883:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ac9496/0x76fb5552835183ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.683905:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038ac9496/0x76fb5552835183ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.683913:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038ac9496/0x76fb5552835183ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.683965:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.683970:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006754cb47/0x76fb5552835183f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.683976:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1523200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.683979:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006754cb47/0x76fb5552835183f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.683987:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006754cb47/0x76fb5552835183f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.683997:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006754cb47/0x76fb5552835183f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.684005:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.684006:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.684008:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181603.689766:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789181603.689781:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006754cb47/0x76fb5552835183f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181603.692612:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.692626:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d8b9617/0x76fb5552835183fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.692647:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.692652:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.692658:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d8b9617/0x76fb5552835183fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.692687:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d8b9617/0x76fb5552835183fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.692698:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d8b9617/0x76fb5552835183fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.692706:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d8b9617/0x76fb5552835183fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.693536:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.693546:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d8b9617/0x76fb5552835183fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.693558:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522e00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.693563:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d8b9617/0x76fb5552835183fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.693586:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d8b9617/0x76fb5552835183fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.693606:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d8b9617/0x76fb5552835183fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.693615:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.693617:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.693618:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.696197:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181603.696227:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789181603.696250:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d8b9617/0x76fb5552835183fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181603.697550:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.697561:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb555283518401 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.697580:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.697584:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.697591:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb555283518401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.697606:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb555283518401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.697632:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb555283518401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.697640:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb555283518401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.697669:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181603.697898:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.697909:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb555283518401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.697919:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1523a00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.697924:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb555283518401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.697936:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb555283518401 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.697957:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb555283518401 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.697965:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb555283518401 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.697999:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.698002:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.698004:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181603.699197:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.699209:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb555283518408 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.699223:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.699226:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.699231:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb555283518408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.699254:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb555283518408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.699263:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb555283518408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.699271:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb555283518408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.699303:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181603.699769:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.699777:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb555283518408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.699797:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1523800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.699801:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb555283518408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.699810:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb555283518408 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.699826:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb555283518408 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.699834:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb555283518408 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.699854:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.699856:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.699857:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181603.700010:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.700017:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f32db6/0x76fb55528351840f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.700027:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.700031:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.700035:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f32db6/0x76fb55528351840f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.700045:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f32db6/0x76fb55528351840f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.700064:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f32db6/0x76fb55528351840f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.700072:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f32db6/0x76fb55528351840f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.700090:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181603.700429:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.700436:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f32db6/0x76fb55528351840f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.700457:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.700460:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f32db6/0x76fb55528351840f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.700470:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f32db6/0x76fb55528351840f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.700494:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f32db6/0x76fb55528351840f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.700502:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f32db6/0x76fb55528351840f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.700518:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.700520:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.700522:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181603.700695:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.700702:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb555283518416 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.700712:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.700750:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.700756:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb555283518416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.700768:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb555283518416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.700777:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb555283518416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.700931:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb555283518416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.700953:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181603.701257:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181603.701264:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb555283518416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.701272:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181603.701276:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb555283518416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.701285:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb555283518416 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.701304:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb555283518416 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.701311:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb555283518416 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.701326:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.701327:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.701329:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181603.701446:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.701452:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000588113e7/0x76fb55528351841d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.701461:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.701465:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.701469:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000588113e7/0x76fb55528351841d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.701492:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000588113e7/0x76fb55528351841d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.701501:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000588113e7/0x76fb55528351841d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.701515:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000588113e7/0x76fb55528351841d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.701535:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789181603.701923:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.701929:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfaa1ee1/0x76fb555283518424 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.701939:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.701942:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.701946:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfaa1ee1/0x76fb555283518424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.701955:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfaa1ee1/0x76fb555283518424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.701963:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfaa1ee1/0x76fb555283518424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.701970:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfaa1ee1/0x76fb555283518424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.702030:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789181603.702471:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789181603.702488:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcd12c39/0x76fb55528351842b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.702504:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=559s v=(0 0) 00010000:00010000:2.0:1789181603.702509:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181603.702513:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcd12c39/0x76fb55528351842b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.702522:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcd12c39/0x76fb55528351842b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.702530:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcd12c39/0x76fb55528351842b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.702537:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcd12c39/0x76fb55528351842b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706229:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789181603.706255:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000588113e7/0x76fb55528351841d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706270:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181603.706276:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000588113e7/0x76fb55528351841d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706288:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000588113e7/0x76fb55528351841d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706318:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000588113e7/0x76fb55528351841d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706326:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000588113e7/0x76fb55528351841d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706356:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181603.706359:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfaa1ee1/0x76fb555283518424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706365:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1523600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181603.706384:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfaa1ee1/0x76fb555283518424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706393:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfaa1ee1/0x76fb555283518424 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706405:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfaa1ee1/0x76fb555283518424 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706411:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfaa1ee1/0x76fb555283518424 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706425:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181603.706428:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcd12c39/0x76fb55528351842b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706435:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1523400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181603.706438:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcd12c39/0x76fb55528351842b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706446:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcd12c39/0x76fb55528351842b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706455:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcd12c39/0x76fb55528351842b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.706463:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181603.706472:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181603.706484:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.707249:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181603.708374:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789181603.708386:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcd12c39/0x76fb55528351842b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.708464:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181603.709184:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789181603.709194:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ecb9f8e/0x76fb555283518432 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.709212:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789181603.709218:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181603.709226:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ecb9f8e/0x76fb555283518432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.709302:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ecb9f8e/0x76fb555283518432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.709316:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ecb9f8e/0x76fb555283518432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.709338:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ecb9f8e/0x76fb555283518432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.709396:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789181603.709787:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789181603.709794:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a160e4d/0x76fb555283518439 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.709805:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789181603.709808:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181603.709813:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a160e4d/0x76fb555283518439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.709823:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a160e4d/0x76fb555283518439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.709832:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a160e4d/0x76fb555283518439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.709839:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a160e4d/0x76fb555283518439 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.714111:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181603.714128:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ecb9f8e/0x76fb555283518432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.714143:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13e00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181603.714149:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ecb9f8e/0x76fb555283518432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.714161:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ecb9f8e/0x76fb555283518432 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.714185:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ecb9f8e/0x76fb555283518432 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.714193:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ecb9f8e/0x76fb555283518432 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.714214:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181603.714217:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a160e4d/0x76fb555283518439 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.714224:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12e00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181603.714227:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a160e4d/0x76fb555283518439 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.715613:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a160e4d/0x76fb555283518439 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.715647:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a160e4d/0x76fb555283518439 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.715662:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181603.715664:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181603.715668:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181603.720711:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789181603.720744:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a160e4d/0x76fb555283518439 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.721310:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181603.721432:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789181603.721441:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283518440 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.721456:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789181603.721460:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181603.721467:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283518440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.721489:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283518440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.721499:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283518440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.721507:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283518440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.721528:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789181603.722132:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181603.722141:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283518440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181603.722159:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181603.722165:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283518440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181603.722175:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283518440 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181603.722195:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283518440 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181603.722203:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000329d8822/0x76fb555283518440 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181603.722223:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181603.722225:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181603.722227:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181603.726453:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789181603.726467:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab7c3f3/0x76fb555283518447 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.726495:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789181603.726499:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181603.726512:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab7c3f3/0x76fb555283518447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.726529:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab7c3f3/0x76fb555283518447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.726540:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab7c3f3/0x76fb555283518447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.726548:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab7c3f3/0x76fb555283518447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.726574:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789181603.727109:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789181603.727117:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c853ff7/0x76fb55528351844e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.727128:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789181603.727132:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181603.727136:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c853ff7/0x76fb55528351844e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.727145:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c853ff7/0x76fb55528351844e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.727153:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c853ff7/0x76fb55528351844e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.727172:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c853ff7/0x76fb55528351844e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.727194:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789181603.727206:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181603.727215:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab7c3f3/0x76fb555283518447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.727223:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181603.727228:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab7c3f3/0x76fb555283518447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.727237:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab7c3f3/0x76fb555283518447 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.727256:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab7c3f3/0x76fb555283518447 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.727264:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab7c3f3/0x76fb555283518447 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.727291:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181603.727294:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c853ff7/0x76fb55528351844e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.727301:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181603.727304:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c853ff7/0x76fb55528351844e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.727311:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c853ff7/0x76fb55528351844e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.727322:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c853ff7/0x76fb55528351844e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.727329:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c853ff7/0x76fb55528351844e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181603.727339:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181603.727341:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181603.727342:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181603.727811:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181603.729561:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789181603.729577:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df27c8cc/0x76fb555283518455 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.729598:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789181603.729603:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181603.729610:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df27c8cc/0x76fb555283518455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.729624:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df27c8cc/0x76fb555283518455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.729634:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df27c8cc/0x76fb555283518455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.729643:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df27c8cc/0x76fb555283518455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181603.729669:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789181603.729758:0:18652:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1789181603.729856:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17170:x1876092408495616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 119803us (120244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181603.729879:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181603.729954:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17170:1876092408495616:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789181603.729971:0:17170:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789181603.730022:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17170:1876092408495744:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789181603.730068:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181603.730092:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc453c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181603.730111:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408495744 00000100:00100000:1.0:1789181603.730118:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408495744 00000100:00100000:1.0:1789181603.730156:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789181603.730164:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17170:x1876092408495744:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789181603.730200:0:18653:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:2.0:1789181603.733924:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181603.733942:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df27c8cc/0x76fb555283518455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.733958:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13000 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181603.733963:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df27c8cc/0x76fb555283518455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.733988:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df27c8cc/0x76fb555283518455 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.734014:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df27c8cc/0x76fb555283518455 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.734022:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df27c8cc/0x76fb555283518455 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181603.734043:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181603.734045:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181603.734047:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789181603.758395:0:18647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789181603.758440:0:18647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789181603.758665:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17170:x1876092408495744:12345-0@lo:5:osp-pre-0-0.0 Request processed in 28496us (28602us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789181603.758679:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181603.759276:0:17170:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789181603.759289:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17170:1876092408495744:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789181603.759308:0:17170:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1789181604.366079:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181604.428554:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789181605.387883:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181606.413855:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181607.438105:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181607.693013:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408495872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181607.693098:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181607.693264:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408495872 00000100:00100000:3.0:1789181607.693273:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408495872 00000100:00100000:3.0:1789181607.693337:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181607.693362:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408495872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181607.693395:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789181607.693454:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408495872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181607.693462:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181607.693505:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408495872:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789181607.693563:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:0.0:1789181608.284896:0:19465:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789181608.284902:0:19465:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789181608.284904:0:19465:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789181608.285085:0:19465:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c1df27eb800 00000020:01000004:0.0:1789181608.285104:0:19465:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789181608.285121:0:19465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789181608.285136:0:19465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c1dc4e019c0) 00000020:00000080:0.0:1789181608.285174:0:19465:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789181608.376871:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789181608.379776:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789181608.380749:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789181608.381083:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789181608.381297:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789181608.382014:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789181608.382319:0:19465:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1789181608.388352:0:19465:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789181608.388690:0:19465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789181608.388706:0:19465:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789181608.389875:0:19465:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x76fb555283518463 00000020:01000004:1.0:1789181608.389889:0:19465:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789181608.389921:0:19465:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789181608.389926:0:19465:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789181608.389934:0:19465:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789181608.389966:0:19465:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789181608.389970:0:19465:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789181608.427902:0:19465:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789181608.427966:0:19465:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789181608.427972:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789181608.427974:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789181608.427975:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181608.427976:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181608.427977:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181608.427979:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181608.427980:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181608.427982:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181608.427983:0:19465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181608.427988:0:19465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789181608.427990:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181608.427991:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789181608.427997:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181608.427998:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181608.427999:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181608.428000:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181608.428001:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181608.428002:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181608.428003:0:19465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181608.428037:0:19465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789181608.428061:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789181608.428161:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.428230:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc4f87b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181608.428455:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408496000 00000100:00100000:1.0:1789181608.428473:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408496000 00000100:00100000:1.0:1789181608.428525:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789181608.428536:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:19465:x1876092408496000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789181608.428570:0:17140:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789181608.428573:0:17140:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789181608.428577:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789181608.428944:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:19465:x1876092408496000:12345-0@lo:253:mount.lustre.0 Request processed in 409us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181608.428966:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789181608.429187:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789181608.429250:0:19465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789181608.429253:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789181608.429255:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789181608.429256:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181608.429257:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181608.429258:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181608.429260:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181608.429261:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181608.429262:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181608.429263:0:19465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789181608.429283:0:19465:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c1df27eb800 from lustre-OST0001 10000000:01000000:2.0:1789181608.429310:0:19465:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789181608.429313:0:19465:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789181608.429321:0:19465:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c1dfaf48000 local copy 00010000:00010000:2.0:1789181608.429329:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181608.429415:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181608.429460:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.429531:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dcf5670c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181608.437841:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408496128 00000100:00100000:0.0:1789181608.437861:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408496128 00000100:00100000:2.0:1789181608.438202:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789181608.438215:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:19465:x1876092408496128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181608.438389:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+21:19465:x1876092408496128:12345-0@lo:501:mount.lustre.0 Request processed in 177us (8928us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789181608.438398:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789181608.438587:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496128:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789181608.438610:0:19465:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789181608.438638:0:19465:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789181608.438646:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.438658:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e800/0x76fb5552835180b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835180b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181608.438686:0:19465:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c1df27eb800 10000000:01000000:3.0:1789181608.438692:0:19465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789181608.438698:0:19465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789181608.438701:0:19465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789181608.438706:0:19465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789181608.438708:0:19465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789181608.438780:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb55528351846a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.438790:0:19465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb55528351846a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.438799:0:19465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb55528351846a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181608.438827:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181608.438861:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.438890:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2fe180 going to sleep for 11 seconds 00000100:00100000:0.0:1789181608.438972:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408496256 00000100:00100000:0.0:1789181608.438978:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408496256 00000100:00100000:0.0:1789181608.439013:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789181608.439021:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+21:19465:x1876092408496256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181608.439032:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181608.439046:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f1600/0x76fb555283518471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351846a expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.439071:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f1600/0x76fb555283518471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351846a expref: 22 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.439082:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f1600/0x76fb555283518471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351846a expref: 22 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.439091:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1600, rc 0) 00000100:00100000:0.0:1789181608.439123:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+22:19465:x1876092408496256:12345-0@lo:101:mount.lustre.0 Request processed in 103us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181608.439136:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789181608.439351:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181608.439364:0:19465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb55528351846a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518471 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.439374:0:19465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb55528351846a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518471 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181608.440549:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789181608.441540:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181608.446047:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789181608.446118:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789181608.446135:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789181608.446150:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789181608.446163:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789181608.446177:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789181608.446221:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789181608.446229:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789181608.446345:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181608.446412:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.446474:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181608.447474:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408496384 00000100:00100000:0.0:1789181608.447486:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408496384 00000100:00100000:0.0:1789181608.447541:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789181608.447551:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+22:19465:x1876092408496384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181608.447775:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+22:19465:x1876092408496384:12345-0@lo:501:mount.lustre.0 Request processed in 225us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181608.447783:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789181608.450566:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181608.450644:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181608.450754:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181608.450795:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7c8b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181608.450886:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408496512 00000100:00100000:2.0:1789181608.450893:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408496512 00000100:00100000:2.0:1789181608.450964:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789181608.450975:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+22:19465:x1876092408496512:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181608.452012:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+22:19465:x1876092408496512:12345-0@lo:503:mount.lustre.0 Request processed in 1033us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181608.452023:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789181608.452205:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496512:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789181608.452692:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789181608.452819:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181608.452873:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.452908:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27a3240 going to sleep for 11 seconds 00000100:00100000:1.0:1789181608.453522:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408496640 00000100:00100000:1.0:1789181608.453532:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408496640 00000100:00100000:1.0:1789181608.453582:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789181608.453592:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+22:19465:x1876092408496640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181608.454325:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+22:19465:x1876092408496640:12345-0@lo:502:mount.lustre.0 Request processed in 730us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181608.454335:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789181608.454493:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789181608.454798:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789181608.454835:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789181608.454851:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789181608.454862:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789181608.454874:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789181608.454887:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789181608.454901:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789181608.454915:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789181608.454928:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789181608.454977:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181608.455033:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181608.455071:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1df9842540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181608.455318:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408496768 00000100:00100000:3.0:1789181608.455325:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408496768 00000100:00100000:3.0:1789181608.455363:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789181608.455371:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+22:19465:x1876092408496768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181608.455495:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+22:19465:x1876092408496768:12345-0@lo:502:mount.lustre.0 Request processed in 125us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181608.455503:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789181608.455771:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789181608.455825:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789181608.455836:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789181608.462928:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789181608.462941:0:19469:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789181608.462949:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181608.462951:0:19469:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789181608.462960:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789181608.462977:0:19469:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c1cc3264d40) 00000020:00000080:3.0:1789181608.463011:0:19469:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789181608.463018:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789181608.463143:0:19469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1df27eb800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789181608.463153:0:19469:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789181608.463161:0:19469:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x76fb55528351847f 00010000:00010000:0.0:1789181608.466329:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181608.478500:0:19469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789181608.481059:0:19469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:3.0:1789181608.486662:0:19469:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789181608.493926:0:19469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789181608.493939:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181608.494066:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181608.494069:0:19469:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789181608.494076:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181608.494081:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181608.494082:0:19469:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789181608.494086:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789181608.494088:0:19469:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789181608.494090:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181608.494092:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181608.494094:0:19469:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789181608.494097:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181608.494099:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181608.494100:0:19469:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789181608.494103:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789181608.494130:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181608.494133:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181608.494134:0:19469:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789181608.494137:0:19469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789181608.503285:0:19465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789181608.503350:0:19465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789181608.503369:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb55528351846a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518471 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.503395:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085e000/0x76fb55528351846a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518471 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181608.503707:0:19465:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1df27eb800 from 1 10000000:01000000:2.0:1789181608.503712:0:19465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181608.503782:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.503791:0:19465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.503803:0:19465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181608.503830:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789181608.503905:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.503945:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27a3240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181608.504288:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408496896 00000100:00100000:3.0:1789181608.504296:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408496896 00000100:00100000:3.0:1789181608.504342:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789181608.504351:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+22:19465:x1876092408496896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181608.504382:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181608.504397:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1e0085e600/0x76fb55528351848d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283518486 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.504423:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1e0085e600/0x76fb55528351848d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283518486 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.504451:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1e0085e600/0x76fb55528351848d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518486 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.504460:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0085e600, rc 0) 00000100:00100000:3.0:1789181608.504511:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:19465:x1876092408496896:12345-0@lo:101:mount.lustre.0 Request processed in 160us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181608.504519:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789181608.504632:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408496896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181608.504653:0:19465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.504662:0:19465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181608.512444:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789181608.512790:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789181608.513043:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789181608.513068:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789181608.513086:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789181608.513092:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789181608.513170:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181608.513258:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.513297:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27a3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789181608.519836:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408497024 00000100:00100000:1.0:1789181608.519853:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408497024 00000100:00100000:1.0:1789181608.519923:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789181608.519935:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+23:19465:x1876092408497024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181608.520140:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+23:19465:x1876092408497024:12345-0@lo:501:mount.lustre.0 Request processed in 208us (6881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181608.520148:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789181608.520326:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181608.520382:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789181608.520443:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.520477:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27a3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181608.520576:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408497152 00000100:00100000:3.0:1789181608.520581:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408497152 00000100:00100000:3.0:1789181608.520617:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789181608.520624:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:19465:x1876092408497152:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181608.520709:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:19465:x1876092408497152:12345-0@lo:503:mount.lustre.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181608.520716:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789181608.520838:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497152:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789181608.521276:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789181608.521346:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181608.521392:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.521416:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27a3240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181608.521597:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408497280 00000100:00100000:3.0:1789181608.521603:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408497280 00000100:00100000:3.0:1789181608.521650:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789181608.521658:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:19465:x1876092408497280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181608.521765:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:19465:x1876092408497280:12345-0@lo:502:mount.lustre.0 Request processed in 107us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181608.521781:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789181608.521821:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff852a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789181608.522007:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789181608.522040:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789181608.522056:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789181608.522071:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789181608.522084:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789181608.522097:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789181608.522110:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789181608.522122:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789181608.522135:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789181608.522149:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789181608.522162:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789181608.522185:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181608.522516:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.522550:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408497408 00000100:00100000:3.0:1789181608.522555:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408497408 00000100:00100000:3.0:1789181608.522578:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789181608.522585:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:19465:x1876092408497408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181608.522658:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:19465:x1876092408497408:12345-0@lo:502:mount.lustre.0 Request processed in 73us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181608.522665:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789181608.522702:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2fe600 going to sleep for 11 seconds 00000100:00100000:3.0:1789181608.522714:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789181608.522769:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789181608.522778:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789181608.529454:0:19473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181608.529471:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181608.529473:0:19473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789181608.529483:0:19473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1df27eb800 00000020:00000080:1.0:1789181608.529487:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181608.529495:0:19473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181608.529498:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181608.529499:0:19473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789181608.529502:0:19473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181608.529505:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181608.529506:0:19473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789181608.529509:0:19473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c1df27eb800 00000020:00000080:1.0:1789181608.529511:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181608.529619:0:19473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181608.529623:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181608.529624:0:19473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789181608.529627:0:19473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181608.529630:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181608.529631:0:19473:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789181608.529635:0:19473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1df27eb800 00000020:00000080:1.0:1789181608.529637:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181608.534895:0:19473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181608.534914:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181608.534916:0:19473:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789181608.534922:0:19473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181608.534927:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181608.534929:0:19473:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789181608.534934:0:19473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c1df27eb800 00000020:00000080:1.0:1789181608.534937:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181608.535207:0:19473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181608.535211:0:19473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181608.535212:0:19473:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789181608.535216:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789181608.535459:0:19465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789181608.535499:0:19465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181608.535522:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.535535:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181608.535598:0:19465:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789181608.535601:0:19465:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c1df27eb800 10000000:01000000:3.0:1789181608.535604:0:19465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c1df27eb800 10000000:01000000:3.0:1789181608.535609:0:19465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789181608.535617:0:19465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c1df27eb800 from 1 10000000:01000000:3.0:1789181608.535620:0:19465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789181608.535659:0:19465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.535668:0:19465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.535680:0:19465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181608.535707:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181608.535828:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.535874:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dfb2fe900 going to sleep for 11 seconds 00000100:00100000:0.0:1789181608.536034:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408497536 00000100:00100000:0.0:1789181608.536043:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408497536 00000100:00100000:0.0:1789181608.536100:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789181608.536110:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:19465:x1876092408497536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181608.536124:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181608.536136:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1cc39f1800/0x76fb55528351849b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283518494 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.536159:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1cc39f1800/0x76fb55528351849b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283518494 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.536170:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1cc39f1800/0x76fb55528351849b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518494 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.536179:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1cc39f1800, rc 0) 00000100:00100000:0.0:1789181608.536493:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408497536:12345-0@lo:101:mount.lustre.0 Request processed in 383us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181608.536501:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789181608.536767:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181608.536785:0:19465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351849b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.536795:0:19465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351849b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181608.538336:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1789181608.539509:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181608.539742:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789181608.539771:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789181608.539802:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789181608.539818:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789181608.539831:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789181608.539843:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789181608.539855:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789181608.539867:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789181608.539879:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789181608.539890:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789181608.539904:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789181608.539916:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789181608.539929:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789181608.539941:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789181608.539954:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789181608.539967:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789181608.539980:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789181608.539992:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789181608.540018:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789181608.540034:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789181608.540048:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789181608.540062:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789181608.540075:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789181608.540091:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789181608.540105:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789181608.540119:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789181608.540133:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789181608.540146:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789181608.540158:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789181608.540183:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789181608.540199:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789181608.540213:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789181608.540227:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789181608.540249:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789181608.540278:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789181608.540294:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789181608.540311:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789181608.540325:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789181608.540339:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1789181608.540350:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1789181608.540362:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1789181608.540375:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1789181608.540387:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1789181608.540399:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1789181608.540413:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1789181608.540425:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1789181608.540465:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1789181608.540473:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1789181608.540572:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181608.540640:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.540689:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181608.541162:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408497664 00000100:00100000:1.0:1789181608.541175:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408497664 00000100:00100000:1.0:1789181608.541235:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789181608.541245:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408497664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181608.541382:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408497664:12345-0@lo:501:mount.lustre.0 Request processed in 138us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181608.541390:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789181608.548166:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181608.548247:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181608.548333:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.548371:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41900 going to sleep for 11 seconds 00000100:00100000:0.0:1789181608.550557:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408497792 00000100:00100000:0.0:1789181608.550576:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408497792 00000100:00100000:0.0:1789181608.550648:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789181608.550658:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408497792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789181608.550864:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408497792:12345-0@lo:503:mount.lustre.0 Request processed in 207us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181608.550872:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789181608.558246:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497792:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789181608.558815:0:19465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181608.558913:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181608.559441:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.559489:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41900 going to sleep for 11 seconds 00000100:00100000:0.0:1789181608.561152:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408497920 00000100:00100000:0.0:1789181608.561167:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408497920 00000100:00100000:0.0:1789181608.562319:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789181608.562338:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408497920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181608.564972:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408497920:12345-0@lo:502:mount.lustre.0 Request processed in 2617us (5521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181608.564989:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789181608.565186:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408497920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789181608.565466:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789181608.565509:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789181608.565523:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789181608.565536:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789181608.565548:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789181608.565560:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789181608.565571:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789181608.565583:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789181608.565595:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789181608.565609:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789181608.565621:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789181608.565634:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789181608.565644:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789181608.565655:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789181608.565667:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789181608.565680:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789181608.565691:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789181608.565702:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789181608.565714:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789181608.565778:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789181608.565793:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789181608.565805:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789181608.565818:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789181608.565830:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789181608.565842:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789181608.565853:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789181608.565865:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789181608.565878:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789181608.565890:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789181608.565902:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789181608.565913:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789181608.565925:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789181608.565937:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789181608.571132:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789181608.571226:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789181608.571261:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789181608.571275:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789181608.571290:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789181608.571301:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789181608.571315:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789181608.571328:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789181608.571340:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789181608.571354:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789181608.571367:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789181608.571382:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789181608.571394:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789181608.571409:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789181608.571423:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789181608.575835:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408498048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181608.575924:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.585780:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc11ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1789181608.594180:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408498048 00000100:00100000:1.0:1789181608.594197:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408498048 00000100:00100000:1.0:1789181608.594254:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789181608.594265:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408498048:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181608.594473:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408498048:12345-0@lo:502:mount.lustre.0 Request processed in 209us (18548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181608.594482:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789181608.595233:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408498048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789181608.595522:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789181608.595555:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789181608.595611:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff851c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408498176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181608.595670:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.595714:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408498176 00000100:00100000:2.0:1789181608.595720:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408498176 00000100:00100000:2.0:1789181608.595774:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789181608.595784:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408498176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181608.595874:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408498176:12345-0@lo:502:mount.lustre.0 Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181608.595882:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789181608.595935:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd9394f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181608.595964:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff851c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408498176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789181608.596004:0:19465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789181608.596012:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789181608.604313:0:19477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789181608.604336:0:19477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c1cc3263380) 00000020:00000080:3.0:1789181608.604363:0:19477:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789181608.604479:0:19477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1df27eb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789181608.604484:0:19477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1df27eb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789181608.604486:0:19477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1df27eb800 3 00010000:00080000:3.0:1789181608.604524:0:19477:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1cc3169800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1789181608.612160:0:19477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789181608.612385:0:19477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789181608.612450:0:19477:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789181608.612466:0:19477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x76fb5552835184a9 00000100:00080000:3.0:1789181608.612479:0:19477:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789181608.612496:0:19477:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c1cc3169800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181608.612540:0:19477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3848e00 x1876092408498304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789181608.612573:0:19477:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789181608.612641:0:63:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789181608.612645:0:63:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789181608.612648:0:63:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789181608.612652:0:63:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1789181608.612656:0:63:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789181608.612661:0:63:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c1cc1d28000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181608.612674:0:63:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc3848000 x1876092408498688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789181608.612710:0:63:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789181608.612759:0:63:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789181608.612762:0:63:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789181608.612767:0:63:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1789181608.612770:0:63:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789181608.612777:0:63:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c1cc1dcc000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1789181608.612795:0:63:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1cc4471f80 x1876092408499200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789181608.612853:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408498432:0@lo:400:kworker.0 00000100:00100000:3.0:1789181608.612927:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181608.613646:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876092408498304:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789181608.620829:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408498816:0@lo:400:kworker.0 00000100:00100000:3.0:1789181608.621285:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408499072:0@lo:400:kworker.0 00000100:00100000:0.0:1789181608.624522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181608.624592:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408498688:0@lo:8:kworker.0 00000100:00100000:0.0:1789181608.624636:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181608.624656:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408499200:0@lo:8:kworker.0 00000100:00100000:0.0:1789181608.624680:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181608.624764:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408498304 00000100:00100000:0.0:1789181608.624774:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408498304 00000100:00100000:0.0:1789181608.624814:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181608.624838:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876092408498304:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789181608.624867:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:0.0:1789181608.624904:0:17147:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x76fb5552835184b0 00000004:00100000:0.0:1789181608.624920:0:17147:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789181608.624973:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9c1cc36c6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181608.625030:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876092408498304:12345-0@lo:38:llog_process_th.0 Request processed in 192us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181608.625038:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181608.625062:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408498688 00000100:00100000:0.0:1789181608.625067:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408498688 00000100:00100000:0.0:1789181608.625087:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408499200 00000100:00100000:0.0:1789181608.625089:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408499200 00000100:00100000:0.0:1789181608.625106:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181608.625110:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408498688:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789181608.625148:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408498688:12345-0@lo:8:kworker.0 Request processed in 37us (511us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789181608.625155:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181608.625167:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181608.625171:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408499200:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789181608.625219:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1876092408499200:12345-0@lo:8:kworker.0 Request processed in 46us (538us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789181608.625225:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789181608.625260:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc3848e00 x1876092408498304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181608.625271:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789181608.625280:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789181608.625287:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789181608.625298:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789181608.625301:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc3169800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789181608.625308:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1876092408498304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789181608.625322:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789181608.625326:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181608.625329:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789181608.625332:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408498688:0@lo:8:kworker.0 00000100:00100000:0.0:1789181608.625340:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789181608.625343:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181608.625346:0:3642:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789181608.625348:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408499200:0@lo:8:kworker.0 00000100:00100000:2.0:1789181608.631932:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.631996:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408499456:0@lo:400:kworker.0 00000100:00100000:2.0:1789181608.632035:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.632063:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789181608.632071:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408498944:0@lo:400:kworker.0 00000100:00100000:2.0:1789181608.632094:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.632111:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408499584:0@lo:400:kworker.0 00000100:00100000:2.0:1789181608.632132:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.632190:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408498816 00000100:00100000:2.0:1789181608.632199:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408498816 00000100:00100000:2.0:1789181608.632240:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408499456 00000100:00100000:2.0:1789181608.632241:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408499456 00000100:00100000:2.0:1789181608.632263:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408499584 00000100:00100000:2.0:1789181608.632265:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408499584 00000100:00100000:2.0:1789181608.632281:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789181608.632290:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408498816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181608.632350:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408498816:12345-0@lo:400:kworker.0 Request processed in 62us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181608.632356:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789181608.632372:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789181608.632378:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408499456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181608.632404:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408499456:12345-0@lo:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181608.632419:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789181608.632450:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181608.632458:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408499584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181608.632486:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408499584:12345-0@lo:400:kworker.0 Request processed in 30us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181608.632491:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181608.632511:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408498432 00000100:00100000:2.0:1789181608.632515:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408498432 00000100:00100000:2.0:1789181608.632537:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408498944 00000100:00100000:2.0:1789181608.632539:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408498944 00000100:00100000:2.0:1789181608.632552:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789181608.632558:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408498432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181608.632592:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408498432:12345-0@lo:400:kworker.0 Request processed in 34us (19665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181608.632597:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789181608.632609:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789181608.632614:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408498944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181608.632642:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408498944:12345-0@lo:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181608.632647:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789181608.632665:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181608.632670:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181608.632703:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408498944:0@lo:400:kworker.0 00010000:00080000:2.0:1789181608.632718:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc4470e00 x1876092408499584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181608.632756:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408499584:0@lo:400:kworker.0 00010000:00080000:2.0:1789181608.632777:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc384a680 x1876092408498816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181608.632785:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408498816:0@lo:400:kworker.0 00010000:00080000:2.0:1789181608.632793:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc4470700 x1876092408499456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181608.632800:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408499456:0@lo:400:kworker.0 00000100:00100000:3.0:1789181608.633716:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.633804:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408498432:0@lo:400:kworker.0 00000100:00100000:3.0:1789181608.633819:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789181608.633830:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408498560:0@lo:400:kworker.0 00000100:00100000:3.0:1789181608.633885:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.633907:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408499328:0@lo:400:kworker.0 00000100:00100000:3.0:1789181608.633928:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.634014:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408499072 00000100:00100000:3.0:1789181608.634021:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408499072 00000100:00100000:3.0:1789181608.634056:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408498560 00000100:00100000:3.0:1789181608.634059:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408498560 00000100:00100000:3.0:1789181608.634086:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181608.634094:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408499072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181608.634143:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408499072:12345-0@lo:400:kworker.0 Request processed in 49us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181608.634159:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181608.634174:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181608.634179:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408498560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181608.634208:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408498560:12345-0@lo:400:kworker.0 Request processed in 29us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181608.634213:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789181608.635371:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181608.635388:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408499328 00000100:00100000:3.0:1789181608.635395:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408499328 00000100:00100000:3.0:1789181608.635443:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181608.635452:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408499328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181608.635510:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408499328:12345-0@lo:400:kworker.0 Request processed in 59us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181608.635517:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181608.635556:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408498560:0@lo:400:kworker.0 00010000:00080000:3.0:1789181608.635569:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1cc4471c00 x1876092408499328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181608.635580:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408499328:0@lo:400:kworker.0 00000100:00100000:3.0:1789181608.635591:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408499072:0@lo:400:kworker.0 00000020:01000004:2.0:1789181608.644131:0:19477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789181608.644151:0:19477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c1dd13e99c0) 00000020:00000080:2.0:1789181608.644180:0:19477:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789181608.644286:0:19477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c1df27eb800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789181608.644291:0:19477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c1df27eb800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789181608.644293:0:19477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c1df27eb800 3 00010000:00080000:2.0:1789181608.644324:0:19477:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c1dfd9f4800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1789181608.645975:0:19477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789181608.646162:0:19477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789181608.646209:0:19477:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789181608.646226:0:19477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x76fb5552835184be 00000100:00080000:2.0:1789181608.646236:0:19477:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789181608.646248:0:19477:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c1dfd9f4800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1789181608.646286:0:19477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dff850700 x1876092408499712/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789181608.646329:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876092408499712:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789181608.646400:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.646475:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408499712 00000100:00100000:2.0:1789181608.646483:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408499712 00000100:00100000:2.0:1789181608.646516:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789181608.646529:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1876092408499712:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789181608.646556:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:2.0:1789181608.646590:0:17147:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x76fb5552835184c5 00000004:00100000:2.0:1789181608.646606:0:17147:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789181608.646637:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9c1dfd9f1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181608.646690:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876092408499712:12345-0@lo:38:llog_process_th.0 Request processed in 160us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181608.646698:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789181608.646773:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c1dff850700 x1876092408499712/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181608.646784:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789181608.646792:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789181608.646800:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789181608.646805:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789181608.646807:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1dfd9f4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789181608.646814:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1876092408499712:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789181608.646851:0:19477:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1789181608.655742:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789181608.659797:0:19465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789181608.659858:0:19465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789181608.659881:0:19465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351849b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181608.659896:0:19465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fe00/0x76fb555283518494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351849b expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789181608.659968:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789181608.659971:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789181608.659972:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181608.659979:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181608.659980:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181608.659982:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181608.659983:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789181608.659985:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181608.659986:0:19465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789181608.659990:0:19465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789181608.659992:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789181608.659993:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789181608.659994:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181608.659995:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181608.659996:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181608.659996:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181608.659997:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789181608.659998:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181608.659999:0:19465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789181608.660033:0:19465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789181608.660060:0:19465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408499840:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789181608.660132:0:19465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181608.660174:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408499840 00000100:00100000:1.0:1789181608.660181:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408499840 00000100:00100000:1.0:1789181608.660228:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789181608.660237:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408499840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789181608.660265:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789181608.660279:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789181608.660412:0:19465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6cfa840 going to sleep for 11 seconds 20000000:01000000:1.0:1789181608.670971:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789181608.670987:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789181608.671248:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:19465:x1876092408499840:12345-0@lo:253:mount.lustre.0 Request processed in 11007us (11112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181608.671258:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789181608.671524:0:19465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:868df35c-3970-416b-9e25-2e3d68c8633a:19465:1876092408499840:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789181608.671539:0:19465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789181608.671543:0:19465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789181608.671545:0:19465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789181608.671546:0:19465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789181608.671548:0:19465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789181608.671549:0:19465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789181608.671550:0:19465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789181608.671552:0:19465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789181608.671554:0:19465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789181608.671556:0:19465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789181608.671572:0:19465:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789181608.671809:0:17161:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789181608.671814:0:17161:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789181608.671838:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.671870:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1cc39f0600/0x76fb555283518375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351836e expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.671879:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1cc39f1400/0x76fb555283518383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351837c expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.671887:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.671923:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1cc39f1400/0x76fb555283518383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb55528351837c expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.671938:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1cc39f1400/0x76fb555283518383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb55528351837c expref: 23 pid: 17139 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181608.672468:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408499968:0@lo:104: 00000100:00100000:3.0:1789181608.672530:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181608.672702:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1cc39f0600/0x76fb555283518375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb55528351836e expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.672713:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1cc39f0600/0x76fb555283518375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb55528351836e expref: 23 pid: 17138 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181608.673021:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408499968 00000100:00100000:2.0:1789181608.673031:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408499968 00000100:00100000:2.0:1789181608.673077:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181608.673087:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:868df35c-3970-416b-9e25-2e3d68c8633a+3:17161:x1876092408499968:12345-0@lo:104: 00010000:00010000:2.0:1789181608.673101:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.673155:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789181608.673161:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:868df35c-3970-416b-9e25-2e3d68c8633a+3:17161:x1876092408499968:12345-0@lo:104: Request processed in 76us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181608.673174:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789181608.673211:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181608.673218:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.673227:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085fc00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181608.673231:0:17897:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.673239:0:17897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181608.673247:0:17897:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181608.673252:0:17897:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181608.673284:0:17897:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.673291:0:17897:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181608.673313:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.673320:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0085fc00/0x76fb55528351837c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518383 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.673331:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181608.673333:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181608.673334:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181608.673340:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181608.673357:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:868df35c-3970-416b-9e25-2e3d68c8633a:3644:1876092408500224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181608.673386:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181608.673422:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408500224 00000100:00100000:2.0:1789181608.673427:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408500224 00010000:00010000:2.0:1789181608.673455:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1cc39f1400/0x76fb555283518383 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb55528351837c expref: 24 pid: 17139 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181608.673477:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181608.673483:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:868df35c-3970-416b-9e25-2e3d68c8633a+24:3644:x1876092408500224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181608.673494:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181608.673499:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1cc39f1400/0x76fb555283518383 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb55528351837c expref: 24 pid: 17139 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.673509:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1cc39f1400/0x76fb555283518383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb55528351837c expref: 24 pid: 17139 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181608.673525:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181608.673552:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:868df35c-3970-416b-9e25-2e3d68c8633a+24:3644:x1876092408500224:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181608.673558:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181608.673592:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:868df35c-3970-416b-9e25-2e3d68c8633a:3644:1876092408500224:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1789181608.673631:0:19465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789181608.681331:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4303480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408500096:0@lo:104: 00002000:00080000:2.0:1789181608.681343:0:19465:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789181608.681350:0:19465:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789181608.681393:0:19465:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789181608.681632:0:19465:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789181608.681651:0:19465:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789181608.681681:0:19465:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000100:00100000:3.0:1789181608.682588:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.682654:0:17161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e413c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789181608.682689:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1cc39f1400/0x76fb555283518383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb55528351837c expref: 23 pid: 17139 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181608.682744:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408499968:0@lo:104: 00000100:00100000:0.0:1789181608.682864:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408500096 00000100:00100000:0.0:1789181608.682873:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408500096 00000100:00100000:0.0:1789181608.682930:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789181608.682941:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:868df35c-3970-416b-9e25-2e3d68c8633a+3:17161:x1876092408500096:12345-0@lo:104: 00010000:00010000:0.0:1789181608.682963:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.683037:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181608.683121:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4303480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1876092408500096:0@lo:104: 00010000:00010000:3.0:1789181608.683145:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181608.683370:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:868df35c-3970-416b-9e25-2e3d68c8633a+3:17161:x1876092408500096:12345-0@lo:104: Request processed in 105us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181608.683380:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789181608.683406:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181608.683414:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.683422:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084ac00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:0.0:1789181608.683426:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.683448:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181608.683456:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181608.683461:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181608.683507:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.683513:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181608.683551:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.683558:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0084ac00/0x76fb55528351836e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518375 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.683582:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181608.683584:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181608.683585:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181608.683755:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:868df35c-3970-416b-9e25-2e3d68c8633a:3644:1876092408500352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181608.683798:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181608.684135:0:18676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408500352 00000100:00100000:0.0:1789181608.684141:0:18676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408500352 00010000:00010000:0.0:1789181608.684168:0:18676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1cc39f0600/0x76fb555283518375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb55528351836e expref: 23 pid: 17138 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181608.684511:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789181608.684523:0:18676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:868df35c-3970-416b-9e25-2e3d68c8633a+23:3644:x1876092408500352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181608.684538:0:18676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181608.684545:0:18676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1cc39f0600/0x76fb555283518375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb55528351836e expref: 23 pid: 17138 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684558:0:18676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1cc39f0600/0x76fb555283518375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb55528351836e expref: 23 pid: 17138 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684573:0:18676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1cc39f0600/0x76fb555283518375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb55528351836e expref: 23 pid: 17138 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684589:0:18676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684598:0:18676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789181608.684616:0:18676:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012802608s 00010000:00010000:0.0:1789181608.684622:0:18676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684644:0:18676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684651:0:18676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684657:0:18676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684663:0:18676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658ae00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181608.684667:0:18676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684675:0:18676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684696:0:18676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181608.684707:0:18676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181608.684766:0:17161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181608.684775:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181608.684779:0:18676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:868df35c-3970-416b-9e25-2e3d68c8633a+22:3644:x1876092408500352:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (981us total) trans 0 rc 0/0 00010000:00010000:3.0:1789181608.684782:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181608.684786:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181608.688916:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:868df35c-3970-416b-9e25-2e3d68c8633a:3644:1876092408500352:0@lo:103:ldlm_bl.0 00000020:00000004:0.0:1789181608.698527:0:19465:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789181608.698832:0:19465:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789181608.717056:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408500480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181608.717130:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.717907:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181608.717919:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408500608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181608.717959:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181608.718013:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408500480 00000100:00100000:3.0:1789181608.718022:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408500480 00000100:00100000:3.0:1789181608.718082:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408500608 00000100:00100000:3.0:1789181608.718086:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408500608 00000100:00100000:3.0:1789181608.718102:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181608.718111:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408500480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181608.718165:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789181608.718338:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789181608.718349:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408500608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789181608.718369:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789181608.718418:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408500608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181608.718447:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789181608.718563:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408500480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 453us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181608.718570:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181608.718621:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408500608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181608.718635:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408500480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181608.720949:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408500736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181608.721023:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181608.721074:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408500736 00000100:00100000:0.0:1789181608.721082:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408500736 00000100:00100000:0.0:1789181608.721139:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181608.721159:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408500736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181608.721182:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789181608.721236:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408500736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181608.721243:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181608.721304:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408500736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789181609.488489:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789181609.546717:0:19531:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181609.547131:0:19531:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789181609.867868:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789181609.867877:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1dc6df7800 from 10 10000000:01000000:1.0:1789181609.867883:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789181609.867932:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12e00/0x76fb5552835184d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181609.867944:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12e00/0x76fb5552835184d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181609.867957:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12e00/0x76fb5552835184d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181609.867985:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408500864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181609.868051:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181609.868101:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181609.868167:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408500864 00000100:00100000:3.0:1789181609.868175:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408500864 00000100:00100000:3.0:1789181609.868235:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789181609.868247:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+22:17142:x1876092408500864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181609.868262:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181609.868278:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835184d3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181609.868317:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835184d3 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181609.868328:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658ae00/0x76fb5552835184da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835184d3 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181609.868337:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658ae00, rc 0) 00000100:00100000:3.0:1789181609.868406:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+23:17142:x1876092408500864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181609.868412:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789181609.868691:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408500864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181609.868708:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12e00/0x76fb5552835184d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835184da expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181609.868718:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12e00/0x76fb5552835184d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835184da expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181609.868818:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408500992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789181609.868855:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181609.868877:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181609.868960:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408500992 00000100:00100000:2.0:1789181609.868966:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408500992 00000100:00100000:2.0:1789181609.869001:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789181609.869016:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+23:17142:x1876092408500992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789181609.869032:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789181609.869050:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789181609.869053:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789181609.869138:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+23:17142:x1876092408500992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181609.869145:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789181609.869307:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408500992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789181609.869364:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789181609.869371:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12e00/0x76fb5552835184d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835184da expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181609.869383:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12e00/0x76fb5552835184d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835184da expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181609.869392:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789181609.869394:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c1cc44fb800 from 10 10000000:01000000:1.0:1789181609.869396:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789181609.869413:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12c00/0x76fb5552835184e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181609.869431:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12c00/0x76fb5552835184e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181609.869439:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12c00/0x76fb5552835184e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181609.869453:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408501120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181609.869483:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181609.869506:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181609.869610:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408501120 00000100:00100000:2.0:1789181609.869615:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408501120 00000100:00100000:2.0:1789181609.869641:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789181609.869648:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:17142:x1876092408501120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181609.869657:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181609.869666:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522200/0x76fb5552835184e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb5552835184e1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181609.869681:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522200/0x76fb5552835184e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb5552835184e1 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181609.869690:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522200/0x76fb5552835184e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835184e1 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181609.869697:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522200, rc 0) 00000100:00100000:2.0:1789181609.883466:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+24:17142:x1876092408501120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 13801us (13965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181609.883484:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789181609.884371:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408501120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181609.884404:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12c00/0x76fb5552835184e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835184e8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181609.884428:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12c00/0x76fb5552835184e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb5552835184e8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181609.884536:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408501248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789181609.884598:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181609.884658:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181609.884802:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408501248 00000100:00100000:2.0:1789181609.884810:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408501248 00000100:00100000:2.0:1789181609.884859:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789181609.884869:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+24:17142:x1876092408501248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789181609.884899:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789181609.884916:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789181609.884918:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789181609.885020:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+24:17142:x1876092408501248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181609.885029:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789181609.886663:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408501248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789181609.886788:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789181609.886799:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12c00/0x76fb5552835184e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835184e8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181609.886810:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12c00/0x76fb5552835184e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb5552835184e8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181610.511630:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181610.896647:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789181611.534121:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181612.556180:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181612.813706:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181612.813759:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408501376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181612.813846:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181612.814283:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408501376 00000100:00100000:3.0:1789181612.814292:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408501376 00000100:00100000:3.0:1789181612.814357:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181612.814367:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408501376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789181612.814408:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789181612.814455:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408501376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181612.814462:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789181612.814520:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181612.814564:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408501376:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789181613.585563:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789181613.838631:0:12308:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789181613.838639:0:12308:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789181613.838642:0:12308:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789181613.838663:0:12308:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c1cc1d28000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1789181613.838689:0:12308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc4378a80 x1876092408501888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789181613.838745:0:12308:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789181613.838749:0:12308:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789181613.838750:0:12308:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789181613.838757:0:12308:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c1cc1dcc000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1789181613.838768:0:12308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c1dc4379180 x1876092408502400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789181613.838828:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408501888:0@lo:8:kworker.0 00000100:00100000:2.0:1789181613.838896:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181613.838930:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408502400:0@lo:8:kworker.0 00000100:00100000:2.0:1789181613.838949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181613.842848:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408501632:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.842950:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181613.843018:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408502272:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843046:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181613.843067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408502912:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843107:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181613.843137:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789181613.843162:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408501504:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843198:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181613.843226:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408502144:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843246:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181613.843261:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408502784:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843280:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181613.843320:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408501632 00000100:00100000:0.0:1789181613.843330:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408501632 00000100:00100000:0.0:1789181613.843375:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408502144 00000100:00100000:0.0:1789181613.843378:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408502144 00000100:00100000:0.0:1789181613.843411:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789181613.843421:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408501632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843485:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408501632:12345-0@lo:400:kworker.0 Request processed in 64us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181613.843492:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789181613.843522:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789181613.843529:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408502144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843558:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408502144:12345-0@lo:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181613.843564:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789181613.843581:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408502912 00000100:00100000:0.0:1789181613.843584:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408502912 00000100:00100000:0.0:1789181613.843616:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408502784 00000100:00100000:0.0:1789181613.843619:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408502784 00000100:00100000:0.0:1789181613.843634:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789181613.843640:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408502912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843671:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876092408502912:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181613.843684:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789181613.843695:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789181613.843700:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408502784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843760:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408502784:12345-0@lo:400:kworker.0 Request processed in 60us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181613.843765:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789181613.843783:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408501504 00000100:00100000:0.0:1789181613.843787:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408501504 00000100:00100000:0.0:1789181613.843812:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789181613.843818:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+24:3646:x1876092408501504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843847:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+24:3646:x1876092408501504:12345-0@lo:400:kworker.0 Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181613.843852:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1789181613.843880:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789181613.843884:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181613.843915:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408501504:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843926:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408502144:0@lo:400:kworker.0 00010000:00080000:0.0:1789181613.843937:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4379500 x1876092408502784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181613.843946:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408502784:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.843956:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408501632:0@lo:400:kworker.0 00010000:00080000:0.0:1789181613.843965:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc437ad80 x1876092408502912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181613.843987:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1876092408502912:0@lo:400:kworker.0 00000100:00100000:1.0:1789181613.844532:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408501760:0@lo:400:kworker.0 00000100:00100000:1.0:1789181613.844583:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181613.844614:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408502528:0@lo:400:kworker.0 00000100:00100000:1.0:1789181613.844636:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181613.844655:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408503040:0@lo:400:kworker.0 00000100:00100000:1.0:1789181613.844678:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181613.844699:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789181613.844706:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408502016:0@lo:400:kworker.0 00000100:00100000:1.0:1789181613.844748:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181613.844767:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408502656:0@lo:400:kworker.0 00000100:00100000:1.0:1789181613.844788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181613.844882:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408501888 00000100:00100000:1.0:1789181613.844904:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408501888 00000100:00100000:1.0:1789181613.844932:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408502400 00000100:00100000:1.0:1789181613.844934:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408502400 00000100:00100000:1.0:1789181613.844942:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408502272 00000100:00100000:1.0:1789181613.844944:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408502272 00000100:00100000:1.0:1789181613.844979:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408501760 00000100:00100000:1.0:1789181613.844981:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408501760 00000100:00100000:1.0:1789181613.845010:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181613.845017:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408502272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181613.845065:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408502272:12345-0@lo:400:kworker.0 Request processed in 49us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181613.845405:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181613.845426:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789181613.845434:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc2f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408501760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181613.845490:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc2f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408501760:12345-0@lo:400:kworker.0 Request processed in 57us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181613.845496:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789181613.845517:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181613.845522:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1876092408501888:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789181613.845553:0:18652:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:1.0:1789181613.845587:0:18652:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x76fb5552835184ef 00002000:00100000:1.0:1789181613.845602:0:18652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c1cc45b9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789181613.845606:0:18652:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789181613.845608:0:18652:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789181613.845988:0:18652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789181613.846014:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9c1cc45b8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181613.846067:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876092408501888:12345-0@lo:8:kworker.0 Request processed in 542us (7169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181613.846248:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181613.846255:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1876092408502400:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789181613.846277:0:18653:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:3.0:1789181613.846299:0:18653:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x76fb5552835184f6 00002000:00100000:3.0:1789181613.846307:0:18653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c1cc316e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789181613.846311:0:18653:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789181613.846313:0:18653:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789181613.846349:0:18653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789181613.846362:0:18653:0:(import.c:65:import_set_state_nolock()) ffff9c1cc316c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181613.846411:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1876092408502400:12345-0@lo:8:kworker.0 Request processed in 155us (7460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181613.846417:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181613.846665:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408503296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181613.846700:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181613.846757:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408503168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181613.846796:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181613.846838:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408503296 00000100:00100000:3.0:1789181613.846845:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408503296 00000100:00100000:3.0:1789181613.846873:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408503168 00000100:00100000:3.0:1789181613.846877:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408503168 00000100:00100000:3.0:1789181613.846905:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789181613.846911:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408503296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181613.846936:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789181613.847053:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408503296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181613.847059:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789181613.847087:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789181613.847094:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408503168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181613.847113:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789181613.847146:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408503168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181613.847152:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789181613.847328:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408503296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181613.847360:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408503168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181613.848121:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789181613.848263:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4378a80 x1876092408501888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789181613.848295:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789181613.848306:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789181613.848312:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789181613.848316:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d28000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789181613.848337:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789181613.848345:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1876092408501888:0@lo:8:kworker.0 00010000:00080000:1.0:1789181613.848365:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4379180 x1876092408502400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789181613.848375:0:3642:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789181613.848380:0:3642:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789181613.848394:0:3642:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789181613.848396:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1dcc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789181613.848409:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789181613.848412:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1876092408502400:0@lo:8:kworker.0 00000004:00080000:1.0:1789181613.848473:0:17172:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1789181613.848493:0:17172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17172:1876092408503552:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789181613.848555:0:17172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181613.848581:0:17172:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae300 going to sleep for 11 seconds 00000100:00100000:1.0:1789181613.848598:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408502528 00000100:00100000:1.0:1789181613.848604:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408502528 00000100:00100000:1.0:1789181613.848633:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408503040 00000100:00100000:1.0:1789181613.848636:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408503040 00000100:00100000:1.0:1789181613.848657:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408502016 00000100:00100000:1.0:1789181613.848660:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408502016 00000100:00100000:1.0:1789181613.848672:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408502656 00000100:00100000:1.0:1789181613.848675:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408502656 00000100:00100000:1.0:1789181613.848703:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789181613.848710:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408502528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181613.848771:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408502528:12345-0@lo:400:kworker.0 Request processed in 62us (4134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181613.848778:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789181613.848790:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181613.848796:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408503040:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1789181613.849154:0:17171:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789181613.849251:0:17171:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 569836526401ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789181613.849258:0:17171:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789181613.851711:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408503040:12345-0@lo:400:kworker.0 Request processed in 2905us (7022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181613.851741:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181613.851776:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181613.851788:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408502016:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1789181613.852013:0:17888:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789181613.852040:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876092408503936:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789181613.852093:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181613.852124:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc25b3cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1789181613.852141:0:17887:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789181613.852229:0:17887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 569839504827ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789181613.852236:0:17887:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789181613.852413:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408503552 00000100:00100000:0.0:1789181613.852421:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408503552 00000100:00100000:0.0:1789181613.852463:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408503936 00000100:00100000:0.0:1789181613.852467:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408503936 00000100:00100000:0.0:1789181613.852501:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789181613.852518:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17172:x1876092408503552:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789181613.852817:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789181613.852826:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1876092408503936:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789181613.852945:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408503424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181613.852986:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181613.853029:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408502272:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.853062:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408503424 00000100:00100000:0.0:1789181613.853065:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408503424 00000100:00100000:0.0:1789181613.853092:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181613.853098:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876092408503424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181613.853115:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789181613.853165:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876092408503424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181613.853172:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789181613.853206:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dfb2aaa00 x1876092408503424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181613.853224:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408503424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181613.853275:0:17147:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789181613.853283:0:17147:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1789181613.853296:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181613.853301:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181613.853305:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789181613.853307:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181613.853316:0:17146:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789181613.853326:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181613.853335:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408502656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.853371:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408502656:12345-0@lo:400:kworker.0 Request processed in 38us (8582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181613.853378:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181613.853417:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408503680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181613.853444:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789181613.853473:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4379f80 x1876092408502656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181613.853483:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408502656:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.853495:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408501760:0@lo:400:kworker.0 00010000:00080000:0.0:1789181613.853507:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4378700 x1876092408502528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181613.853529:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408502528:0@lo:400:kworker.0 00010000:00080000:0.0:1789181613.853546:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc437a300 x1876092408503040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181613.853555:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408503040:0@lo:400:kworker.0 00000100:00100000:0.0:1789181613.853571:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181613.853578:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408503808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181613.853617:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181613.853642:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408503680 00000100:00100000:0.0:1789181613.853646:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408503680 00000100:00100000:0.0:1789181613.853664:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408503808 00000100:00100000:0.0:1789181613.853667:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408503808 00000100:00100000:0.0:1789181613.853679:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789181613.853685:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408503680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181613.853697:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789181613.853762:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408503680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181613.853768:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789181613.853782:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789181613.853788:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1876092408503808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181613.853797:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789181613.853820:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1876092408503808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181613.853826:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789181613.853851:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc384bb80 x1876092408503808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181613.853872:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408503808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181613.853887:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408503680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181613.854574:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408502016:12345-0@lo:400:kworker.0 Request processed in 2781us (9815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181613.854584:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789181613.859418:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4378e00 x1876092408502016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181613.859438:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408502016:0@lo:400:kworker.0 00000004:00080000:3.0:1789181613.865435:0:17877:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1789181613.871331:0:18650:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789181613.871346:0:18650:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789181613.871353:0:18650:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:3.0:1789181613.886210:0:18978:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789181613.886322:0:18978:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789181613.886438:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1876092408503936:12345-0@lo:7:osp-pre-1-1.0 Request processed in 33607us (34339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181613.886462:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789181613.886537:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc384a680 x1876092408503936/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789181629 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181613.886554:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876092408503936:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789181613.886568:0:17888:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789181613.886614:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876092408504064:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789181613.886649:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181613.886674:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd12ab240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181613.886692:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408504064 00000100:00100000:3.0:1789181613.886699:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408504064 00000100:00100000:3.0:1789181613.886753:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789181613.886762:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17888:x1876092408504064:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789181613.886786:0:18652:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789181613.886817:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17888:x1876092408504064:12345-0@lo:5:osp-pre-1-1.0 Request processed in 57us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181613.886824:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789181613.886852:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4301500 x1876092408504064/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181629 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181613.886862:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876092408504064:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789181613.886871:0:17888:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789181613.886895:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876092408504192:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789181613.886916:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181613.886929:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd12ab240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181613.886940:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408504192 00000100:00100000:3.0:1789181613.886950:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408504192 00000100:00100000:3.0:1789181613.889348:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789181613.889370:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17888:x1876092408504192:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789181613.889439:0:18978:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:0.0:1789181613.891547:0:17125:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789181613.892212:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789181613.892296:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000461b9b69/0x76fb5552835184fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.892314:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=569s v=(0 0) 00010000:00010000:3.0:1789181613.892319:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181613.892326:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000461b9b69/0x76fb5552835184fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.892345:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000461b9b69/0x76fb5552835184fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.892355:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000461b9b69/0x76fb5552835184fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.892363:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000461b9b69/0x76fb5552835184fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.892392:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789181613.892497:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181613.892567:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000461b9b69/0x76fb5552835184fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.892576:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a000 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181613.892581:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000461b9b69/0x76fb5552835184fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.892590:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000461b9b69/0x76fb5552835184fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.892611:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000461b9b69/0x76fb5552835184fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.892619:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000461b9b69/0x76fb5552835184fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.892644:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181613.892646:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181613.892648:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789181613.892940:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789181613.892947:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002237da31/0x76fb555283518504 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.894318:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=569s v=(0 0) 00010000:00010000:3.0:1789181613.894328:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181613.894337:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002237da31/0x76fb555283518504 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.894355:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002237da31/0x76fb555283518504 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.894368:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002237da31/0x76fb555283518504 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.894377:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002237da31/0x76fb555283518504 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.894417:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181613.894435:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181613.894442:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002237da31/0x76fb555283518504 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.894451:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658b000 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.894455:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002237da31/0x76fb555283518504 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.894465:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002237da31/0x76fb555283518504 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.894496:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002237da31/0x76fb555283518504 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.894504:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002237da31/0x76fb555283518504 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.894526:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.894528:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.894530:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789181613.895778:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789181613.895787:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000019318cb/0x76fb55528351850b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.895801:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=569s v=(0 0) 00010000:00010000:3.0:1789181613.895805:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181613.895810:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000019318cb/0x76fb55528351850b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.895821:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000019318cb/0x76fb55528351850b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.895960:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000019318cb/0x76fb55528351850b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.896054:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000019318cb/0x76fb55528351850b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.896088:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181613.896102:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181613.896107:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000019318cb/0x76fb55528351850b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.896114:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658ac00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.896119:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000019318cb/0x76fb55528351850b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.896129:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000019318cb/0x76fb55528351850b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.896143:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000019318cb/0x76fb55528351850b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.896150:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000019318cb/0x76fb55528351850b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.896168:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.896170:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.896172:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789181613.899459:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789181613.899474:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8c55c90/0x76fb555283518512 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.899492:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=569s v=(0 0) 00010000:00010000:3.0:1789181613.899505:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181613.899512:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c55c90/0x76fb555283518512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.899527:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8c55c90/0x76fb555283518512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.899538:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8c55c90/0x76fb555283518512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.899546:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c55c90/0x76fb555283518512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.899570:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181613.899584:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181613.899589:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8c55c90/0x76fb555283518512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.899598:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658b200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.899603:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8c55c90/0x76fb555283518512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.899613:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8c55c90/0x76fb555283518512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.899630:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8c55c90/0x76fb555283518512 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.899648:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8c55c90/0x76fb555283518512 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.899668:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.899669:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.899671:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789181613.906089:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789181613.906105:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bde01caa/0x76fb555283518519 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906123:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=569s v=(0 0) 00010000:00010000:3.0:1789181613.906128:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181613.906135:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bde01caa/0x76fb555283518519 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906149:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bde01caa/0x76fb555283518519 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906159:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bde01caa/0x76fb555283518519 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906167:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bde01caa/0x76fb555283518519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906186:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181613.906201:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181613.906213:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bde01caa/0x76fb555283518519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906233:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.906238:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bde01caa/0x76fb555283518519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906246:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bde01caa/0x76fb555283518519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906265:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bde01caa/0x76fb555283518519 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906271:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bde01caa/0x76fb555283518519 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906289:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.906291:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.906292:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789181613.906805:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789181613.906812:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ba551a4/0x76fb555283518520 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906822:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=569s v=(0 0) 00010000:00010000:3.0:1789181613.906826:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181613.906880:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ba551a4/0x76fb555283518520 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906903:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ba551a4/0x76fb555283518520 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906913:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ba551a4/0x76fb555283518520 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906920:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ba551a4/0x76fb555283518520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.906995:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789181613.908748:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789181613.908760:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6e7309/0x76fb555283518527 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.908774:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=569s v=(0 0) 00010000:00010000:3.0:1789181613.908779:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181613.908784:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6e7309/0x76fb555283518527 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.908798:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6e7309/0x76fb555283518527 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.908822:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6e7309/0x76fb555283518527 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.908843:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f6e7309/0x76fb555283518527 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.916506:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789181613.916525:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ba551a4/0x76fb555283518520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.916541:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181613.916547:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ba551a4/0x76fb555283518520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.916559:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ba551a4/0x76fb555283518520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.916585:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ba551a4/0x76fb555283518520 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.916592:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ba551a4/0x76fb555283518520 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.916657:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181613.916663:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f6e7309/0x76fb555283518527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.916669:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658b800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181613.916678:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6e7309/0x76fb555283518527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.916686:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6e7309/0x76fb555283518527 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.916697:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f6e7309/0x76fb555283518527 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.916705:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181613.916706:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181613.916708:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181613.920434:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.920464:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789181613.920477:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f6e7309/0x76fb555283518527 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789181613.923072:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.923085:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004961b56/0x76fb55528351852e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.923104:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.923108:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.923115:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004961b56/0x76fb55528351852e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.923132:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004961b56/0x76fb55528351852e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.923143:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004961b56/0x76fb55528351852e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.923162:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004961b56/0x76fb55528351852e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.923182:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789181613.923658:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.923665:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000079193b3/0x76fb555283518535 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.923675:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.923678:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.923683:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000079193b3/0x76fb555283518535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.923693:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000079193b3/0x76fb555283518535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.923701:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000079193b3/0x76fb555283518535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.923709:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000079193b3/0x76fb555283518535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.923743:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789181613.923761:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181613.923768:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004961b56/0x76fb55528351852e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.923777:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.923782:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004961b56/0x76fb55528351852e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.923792:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004961b56/0x76fb55528351852e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.923824:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004961b56/0x76fb55528351852e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.923833:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004961b56/0x76fb55528351852e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.923851:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181613.923864:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000079193b3/0x76fb555283518535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.923870:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.923873:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000079193b3/0x76fb555283518535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.923881:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000079193b3/0x76fb555283518535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.923892:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000079193b3/0x76fb555283518535 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.923899:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000079193b3/0x76fb555283518535 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.923911:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.923913:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.923915:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.924025:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181613.924840:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.924849:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb55528351853c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.924869:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.924872:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.924877:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb55528351853c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.924889:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb55528351853c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.924899:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb55528351853c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.924906:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb55528351853c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.924924:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789181613.924935:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181613.924940:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb55528351853c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.924948:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181613.924952:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb55528351853c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.924960:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb55528351853c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.924983:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb55528351853c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.924990:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005888d9a9/0x76fb55528351853c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.925005:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181613.925007:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181613.925009:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181613.925338:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.925345:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046020f4f/0x76fb555283518543 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.925354:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.925358:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.925362:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046020f4f/0x76fb555283518543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.925372:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046020f4f/0x76fb555283518543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.925392:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046020f4f/0x76fb555283518543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.925400:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046020f4f/0x76fb555283518543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.925433:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789181613.926043:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.926049:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf0a5be/0x76fb55528351854a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.926060:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.926063:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.926067:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cf0a5be/0x76fb55528351854a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.926076:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cf0a5be/0x76fb55528351854a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.926084:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf0a5be/0x76fb55528351854a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.926091:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cf0a5be/0x76fb55528351854a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.926109:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789181613.928453:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181613.928469:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046020f4f/0x76fb555283518543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.928493:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181613.928499:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046020f4f/0x76fb555283518543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.928511:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046020f4f/0x76fb555283518543 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.928536:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046020f4f/0x76fb555283518543 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.928544:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046020f4f/0x76fb555283518543 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.928574:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181613.928578:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cf0a5be/0x76fb55528351854a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.928585:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f1a00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181613.928588:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf0a5be/0x76fb55528351854a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.928596:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf0a5be/0x76fb55528351854a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.928605:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cf0a5be/0x76fb55528351854a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.928618:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cf0a5be/0x76fb55528351854a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.928632:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.928634:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.928636:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.928986:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181613.929523:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.929532:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b4c2621/0x76fb555283518551 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.929547:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.929561:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.929568:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b4c2621/0x76fb555283518551 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.929583:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b4c2621/0x76fb555283518551 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.929592:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b4c2621/0x76fb555283518551 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.929599:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b4c2621/0x76fb555283518551 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.929620:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789181613.930115:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.930123:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b28524f/0x76fb555283518558 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.930132:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.930136:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.930155:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b28524f/0x76fb555283518558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.930167:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b28524f/0x76fb555283518558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.930177:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b28524f/0x76fb555283518558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.930191:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b28524f/0x76fb555283518558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.930212:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789181613.930656:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.930662:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020260845/0x76fb55528351855f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.930672:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.930676:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.930680:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020260845/0x76fb55528351855f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.930690:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020260845/0x76fb55528351855f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.930699:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020260845/0x76fb55528351855f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.930708:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020260845/0x76fb55528351855f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.930742:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789181613.931035:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.931041:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fead5e17/0x76fb555283518566 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.931055:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.931058:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.931062:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fead5e17/0x76fb555283518566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.931071:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fead5e17/0x76fb555283518566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.931079:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fead5e17/0x76fb555283518566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.931086:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fead5e17/0x76fb555283518566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.931095:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789181613.931618:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.931626:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1e228ab/0x76fb55528351856d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.931636:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.931640:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.931644:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1e228ab/0x76fb55528351856d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.931655:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1e228ab/0x76fb55528351856d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.931675:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1e228ab/0x76fb55528351856d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.931682:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1e228ab/0x76fb55528351856d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.931691:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1789181613.932638:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789181613.932651:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b4c2621/0x76fb555283518551 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932664:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1cc39f0e00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.932670:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b4c2621/0x76fb555283518551 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932698:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b4c2621/0x76fb555283518551 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932742:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b4c2621/0x76fb555283518551 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932751:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b4c2621/0x76fb555283518551 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932773:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789181613.932777:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b28524f/0x76fb555283518558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932784:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.932788:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b28524f/0x76fb555283518558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932796:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b28524f/0x76fb555283518558 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932820:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b28524f/0x76fb555283518558 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932827:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b28524f/0x76fb555283518558 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932853:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789181613.932857:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020260845/0x76fb55528351855f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932864:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.932867:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020260845/0x76fb55528351855f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932876:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020260845/0x76fb55528351855f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932887:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020260845/0x76fb55528351855f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932894:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020260845/0x76fb55528351855f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932907:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181613.932910:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fead5e17/0x76fb555283518566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932916:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.932920:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fead5e17/0x76fb555283518566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932938:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fead5e17/0x76fb555283518566 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932949:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fead5e17/0x76fb555283518566 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932956:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fead5e17/0x76fb555283518566 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932970:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181613.932974:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1e228ab/0x76fb55528351856d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932980:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678800 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.932983:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1e228ab/0x76fb55528351856d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.932989:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1e228ab/0x76fb55528351856d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.933000:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1e228ab/0x76fb55528351856d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.933006:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1e228ab/0x76fb55528351856d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.933032:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.933034:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.933036:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.933046:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.933351:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181613.934441:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.934454:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb555283518574 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.934470:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.934475:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.934481:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb555283518574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.934495:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb555283518574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.934505:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb555283518574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.934513:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb555283518574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.934554:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181613.934600:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181613.934608:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb555283518574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.934615:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181613.934620:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb555283518574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.934629:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb555283518574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.934643:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb555283518574 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.934650:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb555283518574 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.934667:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.934669:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.934676:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181613.936277:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.936291:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a1ba348/0x76fb55528351857b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.936306:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.936310:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.936316:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a1ba348/0x76fb55528351857b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.936335:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a1ba348/0x76fb55528351857b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.936345:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a1ba348/0x76fb55528351857b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.936352:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a1ba348/0x76fb55528351857b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.936369:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789181613.938235:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.938248:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f16fb40/0x76fb555283518582 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.938265:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.938276:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.938282:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f16fb40/0x76fb555283518582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.938295:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f16fb40/0x76fb555283518582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.938305:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f16fb40/0x76fb555283518582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.938313:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f16fb40/0x76fb555283518582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.938341:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789181613.939676:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181613.939687:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a1ba348/0x76fb55528351857b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.939699:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.939704:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1ba348/0x76fb55528351857b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.939714:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1ba348/0x76fb55528351857b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.939775:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a1ba348/0x76fb55528351857b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.939797:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a1ba348/0x76fb55528351857b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.939822:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181613.939826:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f16fb40/0x76fb555283518582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.939832:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678a00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.939847:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f16fb40/0x76fb555283518582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.939856:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f16fb40/0x76fb555283518582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.939866:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f16fb40/0x76fb555283518582 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.939874:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f16fb40/0x76fb555283518582 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.939885:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.939887:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.939889:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181613.940623:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.940636:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cbf97f/0x76fb555283518589 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.940650:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.940656:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.940662:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cbf97f/0x76fb555283518589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.940675:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cbf97f/0x76fb555283518589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.940683:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cbf97f/0x76fb555283518589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.940699:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cbf97f/0x76fb555283518589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.940752:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181613.941629:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181613.941638:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cbf97f/0x76fb555283518589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.941649:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678200 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:3.0:1789181613.941653:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cbf97f/0x76fb555283518589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.941662:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cbf97f/0x76fb555283518589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.941677:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cbf97f/0x76fb555283518589 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.941695:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cbf97f/0x76fb555283518589 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.941719:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.941736:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.941738:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181613.943325:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.943336:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283518590 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.943351:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.943356:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.943361:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283518590 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.943374:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283518590 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.943394:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283518590 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.943402:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283518590 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.943426:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181613.944216:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181613.944226:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283518590 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.944237:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181613.944242:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283518590 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.944250:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283518590 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.944269:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283518590 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.944278:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0d26e41/0x76fb555283518590 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.944297:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.944298:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.944300:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181613.946513:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181613.946717:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.946765:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068deab27/0x76fb555283518597 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.946790:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.946796:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.946802:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068deab27/0x76fb555283518597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.948252:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068deab27/0x76fb555283518597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.948265:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068deab27/0x76fb555283518597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.948275:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068deab27/0x76fb555283518597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.948298:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181613.948936:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181613.948945:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068deab27/0x76fb555283518597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.948956:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181613.948960:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068deab27/0x76fb555283518597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.948970:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068deab27/0x76fb555283518597 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.949008:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068deab27/0x76fb555283518597 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.949016:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068deab27/0x76fb555283518597 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.949044:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181613.949046:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181613.949048:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181613.951035:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.951051:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7297401/0x76fb55528351859e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.952218:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.952229:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.952239:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7297401/0x76fb55528351859e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.952259:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7297401/0x76fb55528351859e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.952287:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7297401/0x76fb55528351859e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.952295:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7297401/0x76fb55528351859e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.952324:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181613.952604:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181613.952612:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7297401/0x76fb55528351859e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.952621:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679000 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181613.952626:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7297401/0x76fb55528351859e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.952647:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7297401/0x76fb55528351859e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.952665:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7297401/0x76fb55528351859e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.952673:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7297401/0x76fb55528351859e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.952698:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.952700:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.952702:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181613.954962:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.954977:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80d0/0x76fb5552835185a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.954995:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.955000:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.955005:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80d0/0x76fb5552835185a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.955018:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80d0/0x76fb5552835185a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.955028:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80d0/0x76fb5552835185a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.955036:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80d0/0x76fb5552835185a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.958456:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789181613.961007:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789181613.961023:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb5552835185ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.961041:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=569s v=(0 0) 00010000:00010000:0.0:1789181613.961047:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181613.961055:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb5552835185ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.961082:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb5552835185ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.961093:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb5552835185ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181613.961101:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb5552835185ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.964188:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181613.964205:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80d0/0x76fb5552835185a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.964221:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679a00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181613.964226:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80d0/0x76fb5552835185a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.964240:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80d0/0x76fb5552835185a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.964261:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80d0/0x76fb5552835185a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.964269:0:17897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80d0/0x76fb5552835185a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.964308:0:17897:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181613.964312:0:17897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb5552835185ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.964318:0:17897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181613.964321:0:17897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb5552835185ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.964329:0:17897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb5552835185ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.964338:0:17897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb5552835185ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.964345:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181613.964347:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181613.964349:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789181613.965553:0:19466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1789181613.965584:0:19466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789181613.965589:0:19466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789181613.966347:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17888:x1876092408504192:12345-0@lo:5:osp-pre-1-1.0 Request processed in 76979us (79422us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789181613.966358:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789181613.966952:0:17888:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789181613.966967:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17888:1876092408504192:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789181613.966985:0:17888:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789181613.967042:0:17888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17888:1876092408504320:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789181613.967218:0:17888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181613.967246:0:17888:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd12ab240 going to sleep for 11 seconds 00000100:00100000:1.0:1789181613.967338:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408504320 00000100:00100000:1.0:1789181613.967345:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408504320 00000100:00100000:1.0:1789181613.967403:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789181613.967411:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17888:x1876092408504320:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789181613.967463:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17888:x1876092408504320:12345-0@lo:900:osp-pre-1-1.0 Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181613.967484:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789181613.967627:0:17888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4301500 x1876092408504320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789181629 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181613.967639:0:17888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17888:1876092408504320:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1789181613.967748:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789181613.967759:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000031346ce/0x76fb5552835185ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181613.968981:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181613.969224:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789181613.969234:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000329d8822/0x76fb5552835185b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.969251:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=569s v=(0 0) 00010000:00010000:1.0:1789181613.969256:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181613.969264:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000329d8822/0x76fb5552835185b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.969278:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000329d8822/0x76fb5552835185b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.969288:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000329d8822/0x76fb5552835185b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.969295:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000329d8822/0x76fb5552835185b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181613.969318:0:18650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789181613.969367:0:18650:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1789181613.969470:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17172:x1876092408503552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 116951us (120911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181613.969481:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181613.969545:0:17172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17172:1876092408503552:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789181613.969561:0:17172:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1789181613.969618:0:17172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17172:1876092408504448:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789181613.969652:0:17172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181613.969677:0:17172:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc27ae300 going to sleep for 11 seconds 00000100:00100000:1.0:1789181613.969694:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408504448 00000100:00100000:1.0:1789181613.969700:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408504448 00000100:00100000:1.0:1789181613.969765:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181613.969775:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17172:x1876092408504448:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789181613.969825:0:18650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1789181613.970009:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181613.970017:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000329d8822/0x76fb5552835185b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.970027:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13c00 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181613.970032:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000329d8822/0x76fb5552835185b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.970043:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000329d8822/0x76fb5552835185b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.970063:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000329d8822/0x76fb5552835185b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.970083:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000329d8822/0x76fb5552835185b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181613.970103:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.970105:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.970107:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181613.984954:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17172:x1876092408504448:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15172us (15293us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789181613.984979:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789181613.987999:0:17172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17172:1876092408504448:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789181613.988022:0:17172:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1789181614.605326:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181614.670041:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789181615.631568:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.653576:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789181617.030388:0:19822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789181617.677824:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181617.939965:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408504576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181617.940037:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181617.940149:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408504576 00000100:00100000:2.0:1789181617.940157:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408504576 00000100:00100000:2.0:1789181617.940281:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789181617.940293:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408504576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789181617.940331:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789181617.940393:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408504576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181617.940400:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789181617.940451:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408504576:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789181617.940632:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:1.0:1789181618.284890:0:19874:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789181618.285109:0:19874:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789181618.699946:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181618.955962:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408504704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181618.956075:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181618.956182:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408504704 00000100:00100000:3.0:1789181618.956202:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408504704 00000100:00100000:3.0:1789181618.956254:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789181618.956265:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408504704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181618.956302:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789181618.956362:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408504704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181618.956369:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789181618.956425:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408504704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181618.957041:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408504960:0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.957082:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181618.957129:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408505472:0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.957153:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181618.957171:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408505984:0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.957208:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181618.957230:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789181618.957235:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:868df35c-3970-416b-9e25-2e3d68c8633a:3644:1876092408504832:0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.957259:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181618.957279:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408505344:0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.957295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181618.957309:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408505856:0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.957352:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181618.957376:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dfb2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408506368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789181618.957394:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181618.957420:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408505472 00000100:00100000:1.0:1789181618.957425:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408505472 00000100:00100000:2.0:1789181618.957629:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408504960 00000100:00100000:2.0:1789181618.957634:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408504960 00000100:00100000:2.0:1789181618.957668:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408506368 00000100:00100000:2.0:1789181618.957671:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408506368 00000100:00100000:2.0:1789181618.957684:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181618.957693:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408504960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181618.957772:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876092408504960:12345-0@lo:400:kworker.0 Request processed in 79us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181618.957779:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181618.957792:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789181618.957805:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408506368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789181618.957826:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789181618.957859:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408506368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181618.957864:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789181618.957962:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789181618.957970:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408505472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.958004:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408505472:12345-0@lo:400:kworker.0 Request processed in 35us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181618.958010:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789181618.958029:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408505984 00000100:00100000:1.0:1789181618.958033:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408505984 00000100:00100000:1.0:1789181618.958069:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408505344 00000100:00100000:1.0:1789181618.958072:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408505344 00000100:00100000:1.0:1789181618.958085:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408505856 00000100:00100000:1.0:1789181618.958087:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408505856 00000100:00100000:1.0:1789181618.958167:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789181618.958173:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408505984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.958395:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876092408505984:12345-0@lo:400:kworker.0 Request processed in 221us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181618.958402:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789181618.958417:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789181618.958423:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408505344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.958604:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876092408505344:12345-0@lo:400:kworker.0 Request processed in 180us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181618.958609:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789181618.958619:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789181618.958629:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408505856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.958648:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876092408505856:12345-0@lo:400:kworker.0 Request processed in 20us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181618.958652:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789181618.958668:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408504832 00000100:00100000:1.0:1789181618.958671:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408504832 00000100:00100000:1.0:1789181618.958740:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789181618.958745:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:3644:x1876092408504832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181618.958765:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:3644:x1876092408504832:12345-0@lo:400:kworker.0 Request processed in 21us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181618.958769:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789181618.958857:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408505088:0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.958895:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181618.958925:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408505600:0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.958946:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181618.958963:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408506112:0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.958988:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181618.959008:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789181618.959014:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408505216:0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.959038:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181618.959056:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408505728:0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.959076:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181618.959087:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408506240:0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.959125:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181618.959149:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408505088 00000100:00100000:3.0:1789181618.959153:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408505088 00000100:00100000:3.0:1789181618.959182:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408505600 00000100:00100000:3.0:1789181618.959194:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408505600 00000100:00100000:3.0:1789181618.959203:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408505216 00000100:00100000:3.0:1789181618.959205:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408505216 00000100:00100000:3.0:1789181618.959214:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181618.959217:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408505088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.959243:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408505088:12345-0@lo:400:kworker.0 Request processed in 26us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181618.959247:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181618.959255:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181618.959258:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408505600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.959274:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408505600:12345-0@lo:400:kworker.0 Request processed in 15us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181618.959277:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181618.959282:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181618.959285:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408505216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.959298:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408505216:12345-0@lo:400:kworker.0 Request processed in 13us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181618.959301:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181618.959309:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408506112 00000100:00100000:3.0:1789181618.959311:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408506112 00000100:00100000:3.0:1789181618.959330:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408505728 00000100:00100000:3.0:1789181618.959332:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408505728 00000100:00100000:3.0:1789181618.959350:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408506240 00000100:00100000:3.0:1789181618.959353:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408506240 00000100:00100000:3.0:1789181618.959367:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181618.959372:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408506112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.959408:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408506112:12345-0@lo:400:kworker.0 Request processed in 36us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181618.959421:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181618.959512:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181618.959520:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408505728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.959579:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408505728:12345-0@lo:400:kworker.0 Request processed in 59us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181618.959585:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181618.959598:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789181618.959604:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408506240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.959626:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408506240:12345-0@lo:400:kworker.0 Request processed in 23us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181618.959630:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789181618.959676:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181618.959683:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408506496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181618.959710:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181618.959757:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408506496 00000100:00100000:3.0:1789181618.959761:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408506496 00000100:00100000:3.0:1789181618.959785:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181618.959791:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408506496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181618.959812:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789181618.959845:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408506496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181618.959851:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181618.959896:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408506496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181618.959929:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408506624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181618.959958:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181618.959980:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408505216:0@lo:400:kworker.0 00010000:00080000:3.0:1789181618.959992:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4378a80 x1876092408505728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181618.960003:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408505728:0@lo:400:kworker.0 00010000:00080000:3.0:1789181618.960010:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc437b480 x1876092408506240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181618.960018:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408506240:0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.960026:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408505088:0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.960032:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408505600:0@lo:400:kworker.0 00010000:00080000:3.0:1789181618.960039:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4379500 x1876092408506112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181618.960047:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408506112:0@lo:400:kworker.0 00000100:00100000:3.0:1789181618.960064:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181618.960068:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408506752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181618.960088:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181618.960111:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408506624 00000100:00100000:3.0:1789181618.960115:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408506624 00000100:00100000:3.0:1789181618.960130:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408506752 00000100:00100000:3.0:1789181618.960132:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408506752 00000100:00100000:3.0:1789181618.960142:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181618.960149:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408506624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181618.960159:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789181618.960201:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408506624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181618.960207:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181618.960219:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181618.960230:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408506752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181618.960239:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789181618.960263:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408506752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181618.960269:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181618.960306:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408506752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181618.960317:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408506624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181618.962114:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:868df35c-3970-416b-9e25-2e3d68c8633a:3644:1876092408504832:0@lo:400:kworker.0 00010000:00080000:0.0:1789181618.962139:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc4379f80 x1876092408505344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181618.962152:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876092408505344:0@lo:400:kworker.0 00010000:00080000:0.0:1789181618.962165:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc437ad80 x1876092408505856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181618.962173:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1876092408505856:0@lo:400:kworker.0 00000100:00100000:0.0:1789181618.962196:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dfb2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408506368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181618.962206:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408504960:0@lo:400:kworker.0 00000100:00100000:0.0:1789181618.962217:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408505472:0@lo:400:kworker.0 00010000:00080000:0.0:1789181618.962229:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc437bb80 x1876092408505984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181618.962238:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1876092408505984:0@lo:400:kworker.0 00000100:00080000:0.0:1789181618.962293:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181618.962302:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789181618.962322:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181618.962325:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:3.0:1789181619.361228:0:19924:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789181619.361553:0:19924:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789181619.563759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.563927:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385348608 00000100:00100000:0.0:1789181619.563940:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385348608 00000100:00100000:0.0:1789181619.563982:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:0.0:1789181619.563992:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2392:x1876092385348608:12345-192.168.202.1@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789181619.564026:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7bec7f81-b22c-449b-9b54-80d117d39796@192.168.202.1@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:0.0:1789181619.564062:0:17140:0:(genops.c:1384:class_connect()) connect: client 7bec7f81-b22c-449b-9b54-80d117d39796, cookie 0x76fb5552835185ba 00000100:00080000:0.0:1789181619.564199:0:17140:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d2a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181619.564275:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+5:2392:x1876092385348608:12345-192.168.202.1@tcp:250:mount.lustre.0 Request processed in 283us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.564282:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 117 00000100:00100000:3.0:1789181619.580598:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181619.582505:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385348736 00000100:00100000:1.0:1789181619.582521:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385348736 00000100:00100000:1.0:1789181619.582599:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:1.0:1789181619.582612:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+5:14888:x1876092385348736:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789181619.582634:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181619.582655:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1de0b13000/0x76fb5552835185c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df829b expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181619.582685:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1de0b13000/0x76fb5552835185c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df829b expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181619.582696:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1de0b13000/0x76fb5552835185c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df829b expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181619.582706:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13000, rc 0) 00000100:00100000:1.0:1789181619.582818:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+6:14888:x1876092385348736:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 209us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181619.582843:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:1.0:1789181619.589503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181619.589633:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385348864 00000100:00100000:2.0:1789181619.589649:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385348864 00000100:00100000:2.0:1789181619.589763:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1789181619.589776:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+6:14888:x1876092385348864:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789181619.589945:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+6:14888:x1876092385348864:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 171us (452us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789181619.589954:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:1.0:1789181619.595700:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.595848:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385348992 00000100:00100000:0.0:1789181619.595859:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385348992 00000100:00100000:0.0:1789181619.595911:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1789181619.595922:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+6:14888:x1876092385348992:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789181619.595940:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181619.595959:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1678c00/0x76fb5552835185c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df82a2 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181619.595991:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1678c00/0x76fb5552835185c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82a2 expref: 7 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181619.596003:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1678c00/0x76fb5552835185c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82a2 expref: 7 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181619.596013:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1678c00, rc 0) 00000100:00100000:0.0:1789181619.596082:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+7:14888:x1876092385348992:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 161us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.596103:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:3.0:1789181619.597915:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181619.598020:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385349120 00000100:00100000:1.0:1789181619.598032:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385349120 00000100:00100000:1.0:1789181619.598108:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:1.0:1789181619.598121:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+7:14888:x1876092385349120:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789181619.598282:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+8:14888:x1876092385349120:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 163us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181619.598291:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:1.0:1789181619.607694:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181619.608758:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385349248 00000100:00100000:2.0:1789181619.608774:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385349248 00000100:00100000:2.0:1789181619.608845:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:2.0:1789181619.608855:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+8:14888:x1876092385349248:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789181619.609019:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+8:14888:x1876092385349248:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 165us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181619.609027:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:3.0:1789181619.611304:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.611408:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385349376 00000100:00100000:0.0:1789181619.611417:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385349376 00000100:00100000:0.0:1789181619.611468:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:0.0:1789181619.611478:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+8:14907:x1876092385349376:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181619.611658:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+8:14907:x1876092385349376:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 180us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.611666:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:3.0:1789181619.638453:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181619.638652:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385349504 00000100:00100000:1.0:1789181619.638664:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385349504 00000100:00100000:1.0:1789181619.638776:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:1.0:1789181619.638788:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+8:14907:x1876092385349504:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181619.639177:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+8:14907:x1876092385349504:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 389us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181619.639185:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:3.0:1789181619.644831:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181619.644928:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385349632 00000100:00100000:2.0:1789181619.644940:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385349632 00000100:00100000:2.0:1789181619.644998:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:2.0:1789181619.645009:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+8:14907:x1876092385349632:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181619.645177:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+8:14907:x1876092385349632:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 169us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181619.645185:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:3.0:1789181619.661259:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.661392:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385349760 00000100:00100000:0.0:1789181619.661404:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385349760 00000100:00100000:0.0:1789181619.661470:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:0.0:1789181619.661482:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+8:14888:x1876092385349760:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789181619.661502:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181619.661521:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1678800/0x76fb5552835185cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df82d3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181619.661553:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1678800/0x76fb5552835185cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82d3 expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181619.661565:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1678800/0x76fb5552835185cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82d3 expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181619.661574:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1678800, rc 0) 00000100:00100000:0.0:1789181619.661660:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+9:14888:x1876092385349760:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 180us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.661668:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:3.0:1789181619.665581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.665938:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385349888 00000100:00100000:0.0:1789181619.665949:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385349888 00000100:00100000:0.0:1789181619.666010:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:0.0:1789181619.666020:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+9:14888:x1876092385349888:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789181619.666048:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789181619.666071:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789181619.666076:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789181619.666079:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789181619.666081:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789181619.666084:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789181619.668001:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+9:14888:x1876092385349888:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 1970us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.668018:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:3.0:1789181619.671473:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.673162:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385350016 00000100:00100000:0.0:1789181619.673179:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385350016 00000100:00100000:0.0:1789181619.673271:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:0.0:1789181619.673285:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+9:14888:x1876092385350016:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789181619.673309:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181619.673338:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1679400/0x76fb5552835185d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df82da expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181619.673373:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1679400/0x76fb5552835185d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82da expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181619.673386:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1679400/0x76fb5552835185d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82da expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181619.673395:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679400, rc 0) 00000100:00100000:0.0:1789181619.673488:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+10:14888:x1876092385350016:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 206us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.673496:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:3.0:1789181619.675822:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.675976:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385350144 00000100:00100000:0.0:1789181619.675988:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385350144 00000100:00100000:0.0:1789181619.676050:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:0.0:1789181619.676061:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+10:14888:x1876092385350144:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789181619.676231:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+10:14888:x1876092385350144:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 171us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.676239:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:3.0:1789181619.678864:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181619.683032:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385350272 00000100:00100000:2.0:1789181619.683051:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385350272 00000100:00100000:2.0:1789181619.683122:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:2.0:1789181619.683135:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+10:14888:x1876092385350272:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789181619.683311:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+10:14888:x1876092385350272:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 178us (4454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181619.683319:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:3.0:1789181619.686799:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181619.687229:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385350400 00000100:00100000:2.0:1789181619.687241:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385350400 00000100:00100000:2.0:1789181619.687309:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:2.0:1789181619.687322:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+10:14912:x1876092385350400:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181619.687782:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+10:14912:x1876092385350400:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 206us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181619.687794:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:3.0:1789181619.697210:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.697336:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385350528 00000100:00100000:0.0:1789181619.697351:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385350528 00000100:00100000:0.0:1789181619.697422:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:0.0:1789181619.697434:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+10:14912:x1876092385350528:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181619.697636:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+10:14912:x1876092385350528:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 203us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.697645:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:1.0:1789181619.721678:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181619.721820:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.721985:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385350656 00000100:00100000:0.0:1789181619.721996:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385350656 00000100:00100000:0.0:1789181619.722052:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385350912 00000100:00100000:0.0:1789181619.722055:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385350912 00000100:00100000:0.0:1789181619.722077:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1789181619.722086:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876092385350656:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789181619.722129:0:19683:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c5862b8c-2b27-4ce8-9320-ff219707bd0a@192.168.202.1@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:0.0:1789181619.722180:0:19683:0:(genops.c:1384:class_connect()) connect: client c5862b8c-2b27-4ce8-9320-ff219707bd0a, cookie 0x76fb5552835185dd 00000004:00100000:0.0:1789181619.722206:0:19683:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789181619.722468:0:19683:0:(import.c:65:import_set_state_nolock()) ffff9c1cc1d2e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181619.722780:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1789181619.722788:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1876092385350912:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789181619.722811:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from c5862b8c-2b27-4ce8-9320-ff219707bd0a@192.168.202.1@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:2.0:1789181619.722860:0:17147:0:(genops.c:1384:class_connect()) connect: client c5862b8c-2b27-4ce8-9320-ff219707bd0a, cookie 0x76fb5552835185e4 00000004:00100000:2.0:1789181619.722878:0:17147:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789181619.723022:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9c1dfb992000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181619.723061:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2392:x1876092385350912:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 272us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181619.723072:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1789181619.723218:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2392:x1876092385350656:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 463us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.723225:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00010000:00010000:2.0:1789181619.723866:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181619.732602:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181619.733018:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181619.733047:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.745095:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385351168 00000100:00100000:0.0:1789181619.745113:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385351168 00000100:00100000:0.0:1789181619.745219:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385351040 00000100:00100000:0.0:1789181619.745223:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385351040 00000100:00100000:0.0:1789181619.745239:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385350784 00000100:00100000:0.0:1789181619.745241:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385350784 00000100:00100000:0.0:1789181619.745260:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1789181619.745270:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:14888:x1876092385351168:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789181619.745309:0:19683:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789181619.745430:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:14888:x1876092385351168:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 151us (12828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.745438:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1789181619.745457:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1789181619.745464:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:0:x1876092385351040:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789181619.745480:0:19683:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789181619.745556:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:0:x1876092385351040:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 81us (12528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.745562:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:0.0:1789181619.745577:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:0.0:1789181619.745584:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:0:x1876092385350784:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789181619.745595:0:19683:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789181619.745618:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:0:x1876092385350784:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 35us (12570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.745633:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00080000:1.0:1789181619.746029:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789181619.746034:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181619.759966:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.763712:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385351296 00000100:00100000:0.0:1789181619.763744:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385351296 00000100:00100000:1.0:1789181619.768980:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:1.0:1789181619.768998:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14888:x1876092385351296:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789181619.769130:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14888:x1876092385351296:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 134us (9174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181619.769138:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1789181619.775647:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.775693:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181619.776011:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385351424 00000100:00100000:3.0:1789181619.776046:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385351424 00000100:00100000:3.0:1789181619.776110:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385351552 00000100:00100000:3.0:1789181619.776113:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385351552 00000100:00100000:3.0:1789181619.776135:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1789181619.776144:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1876092385351424:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789181619.776197:0:18653:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c5862b8c-2b27-4ce8-9320-ff219707bd0a@192.168.202.1@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:3.0:1789181619.776230:0:18653:0:(genops.c:1384:class_connect()) connect: client c5862b8c-2b27-4ce8-9320-ff219707bd0a, cookie 0x76fb5552835185eb 00002000:00100000:3.0:1789181619.776244:0:18653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c5862b8c-2b27-4ce8-9320-ff219707bd0a/ffff9c1cc3169000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789181619.776273:0:18653:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789181619.776493:0:18653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789181619.776493:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00080000:3.0:1789181619.776525:0:18653:0:(import.c:65:import_set_state_nolock()) ffff9c1cc3168000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181619.776533:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1789181619.776538:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1876092385351552:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789181619.776556:0:18652:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c5862b8c-2b27-4ce8-9320-ff219707bd0a@192.168.202.1@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:2.0:1789181619.776572:0:18652:0:(genops.c:1384:class_connect()) connect: client c5862b8c-2b27-4ce8-9320-ff219707bd0a, cookie 0x76fb5552835185f2 00002000:00100000:2.0:1789181619.776577:0:18652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c5862b8c-2b27-4ce8-9320-ff219707bd0a/ffff9c1dfb991800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789181619.776593:0:18652:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789181619.776605:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2392:x1876092385351424:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 460us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181619.776612:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00002000:00080000:2.0:1789181619.776716:0:18652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789181619.776751:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9c1dfb997000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181619.776776:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2392:x1876092385351552:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 236us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181619.776783:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1789181619.777185:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385351680 00000100:00100000:1.0:1789181619.777193:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385351680 00000100:00100000:1.0:1789181619.777252:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:1.0:1789181619.777260:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14888:x1876092385351680:12345-192.168.202.1@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789181619.777335:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14888:x1876092385351680:12345-192.168.202.1@tcp:900:mount.lustre.0 Request processed in 67us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181619.777342:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000001:00100000:2.0:1789181619.779895:0:19466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5862b8c-2b27-4ce8-9320-ff219707bd0a 00000001:00080000:2.0:1789181619.779913:0:19466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:2.0:1789181619.784803:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181619.784876:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385351808 00000100:00100000:0.0:1789181619.784887:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385351808 00000100:00100000:0.0:1789181619.784950:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1789181619.784961:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14888:x1876092385351808:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789181619.789960:0:17148:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4895us 00000004:00200000:0.0:1789181619.813097:0:17148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789181619.813242:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14888:x1876092385351808:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 28277us (28446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181619.813256:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1789181620.051380:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181620.052369:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385351936 00000100:00100000:2.0:1789181620.052384:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385351936 00000100:00100000:2.0:1789181620.052514:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1789181620.052526:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14935:x1876092385351936:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:2.0:1789181620.052546:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181620.052625:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522a00/0x76fb5552835185f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df830b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181620.052711:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522400/0x76fb555283518600 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181620.052743:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522400/0x76fb555283518600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181620.052769:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522400/0x76fb555283518600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181620.052820:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789181620.052824:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181620.052884:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522400/0x76fb555283518600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181620.052921:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522a00/0x76fb5552835185f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df830b expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181620.052940:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522400/0x76fb555283518600 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df830b expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181620.052949:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc7121300) 00010000:00010000:2.0:1789181620.052952:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181620.052955:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522400, rc 0) 00000100:00100000:2.0:1789181620.053072:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:14935:x1876092385351936:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 549us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181620.053079:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000040:00080000:0.0:1789181620.110085:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789181620.749504:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181621.777806:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181622.222606:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181622.222692:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385352064 00000100:00100000:1.0:1789181622.222706:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385352064 00000100:00100000:1.0:1789181622.222817:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:1.0:1789181622.222828:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:14988:x1876092385352064:12345-192.168.202.1@tcp:41:lfs.0 00000004:00000024:1.0:1789181622.222869:0:19683:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789181622.222967:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:14988:x1876092385352064:12345-192.168.202.1@tcp:41:lfs.0 Request processed in 141us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181622.222974:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00080000:0.0:1789181622.223073:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181622.226945:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181622.227202:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385352192 00000100:00100000:0.0:1789181622.227214:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385352192 00000100:00100000:0.0:1789181622.227300:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1789181622.227324:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14988:x1876092385352192:12345-192.168.202.1@tcp:41:lfs.0 00000004:00000024:0.0:1789181622.227364:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1789181622.227716:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789181622.227804:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14988:x1876092385352192:12345-192.168.202.1@tcp:41:lfs.0 Request processed in 482us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181622.227812:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1789181622.239132:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181622.240490:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385352320 00000100:00100000:0.0:1789181622.240520:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385352320 00000100:00100000:0.0:1789181622.240603:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1789181622.240616:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14988:x1876092385352320:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:0.0:1789181622.240668:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789181622.240799:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:14988:x1876092385352320:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 186us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181622.240807:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:2.0:1789181622.241054:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181622.243937:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181622.244011:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385352448 00000100:00100000:3.0:1789181622.244022:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385352448 00000100:00080000:2.0:1789181622.244146:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181622.244215:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:3.0:1789181622.244226:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:14988:x1876092385352448:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:3.0:1789181622.244258:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789181622.244353:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:14988:x1876092385352448:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 129us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181622.244360:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1789181622.475483:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.475631:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385352576 00000100:00100000:2.0:1789181622.475643:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385352576 00000100:00100000:2.0:1789181622.475705:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:2.0:1789181622.475716:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+10:15019:x1876092385352576:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789181622.475771:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181622.475789:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1522e00/0x76fb555283518607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8312 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181622.475831:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1522e00/0x76fb555283518607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8312 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181622.475844:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1522e00/0x76fb555283518607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8312 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181622.475854:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522e00, rc 0) 00000100:00100000:2.0:1789181622.476053:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+11:15019:x1876092385352576:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 338us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181622.476062:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:2.0:1789181622.481634:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181622.481835:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385352704 00000100:00100000:0.0:1789181622.481846:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385352704 00000100:00100000:0.0:1789181622.481903:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:0.0:1789181622.481914:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+11:15019:x1876092385352704:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789181622.482076:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+11:15019:x1876092385352704:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 163us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181622.482084:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:3.0:1789181622.498999:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.499111:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385352832 00000100:00100000:2.0:1789181622.499122:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385352832 00000100:00100000:2.0:1789181622.499184:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1789181622.499194:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+11:15019:x1876092385352832:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789181622.499354:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+11:15019:x1876092385352832:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 160us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181622.499362:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:1.0:1789181622.516761:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.516986:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385352960 00000100:00100000:2.0:1789181622.517012:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385352960 00000100:00100000:2.0:1789181622.517082:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:2.0:1789181622.517093:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+11:15026:x1876092385352960:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181622.517263:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+11:15026:x1876092385352960:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 171us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181622.517272:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:1.0:1789181622.538232:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181622.538328:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385353088 00000100:00100000:0.0:1789181622.538337:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385353088 00000100:00100000:0.0:1789181622.538390:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:0.0:1789181622.538399:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+11:15026:x1876092385353088:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181622.538568:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+11:15026:x1876092385353088:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 169us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181622.538576:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:3.0:1789181622.544638:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181622.545097:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385353216 00000100:00100000:0.0:1789181622.545108:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385353216 00000100:00100000:0.0:1789181622.545167:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:0.0:1789181622.545183:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+11:15026:x1876092385353216:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181622.545983:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+11:15026:x1876092385353216:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 796us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181622.545994:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:1.0:1789181622.569923:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.570023:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385353344 00000100:00100000:2.0:1789181622.570034:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385353344 00000100:00100000:2.0:1789181622.570105:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:2.0:1789181622.570116:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+11:15019:x1876092385353344:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789181622.570140:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181622.570158:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1523400/0x76fb55528351860e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8343 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181622.570193:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1523400/0x76fb55528351860e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8343 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181622.570205:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1523400/0x76fb55528351860e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8343 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181622.570215:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523400, rc 0) 00000100:00100000:2.0:1789181622.570343:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+12:15019:x1876092385353344:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 229us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181622.570354:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:1.0:1789181622.595661:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181622.595813:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385353472 00000100:00100000:0.0:1789181622.595823:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385353472 00000100:00100000:0.0:1789181622.595875:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:0.0:1789181622.595885:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+12:15019:x1876092385353472:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789181622.595913:0:17140:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789181622.595931:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789181622.595936:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789181622.595940:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789181622.595942:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789181622.595945:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789181622.611978:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+12:15019:x1876092385353472:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 16081us (16314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181622.611995:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:1.0:1789181622.614836:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181622.614982:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385353600 00000100:00100000:0.0:1789181622.614993:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385353600 00000100:00100000:0.0:1789181622.615056:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:0.0:1789181622.615082:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+12:15019:x1876092385353600:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789181622.615098:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181622.615118:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1678a00/0x76fb555283518615 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df834a expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181622.615148:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1678a00/0x76fb555283518615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df834a expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181622.615161:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1678a00/0x76fb555283518615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df834a expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181622.615193:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1678a00, rc 0) 00000100:00100000:0.0:1789181622.615257:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+13:15019:x1876092385353600:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 192us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181622.615264:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:2.0:1789181622.617982:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181622.618085:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385353728 00000100:00100000:1.0:1789181622.618094:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385353728 00000100:00100000:1.0:1789181622.618152:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:1.0:1789181622.618162:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+13:15019:x1876092385353728:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789181622.618334:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+13:15019:x1876092385353728:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 172us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181622.618343:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:1.0:1789181622.622218:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.626978:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385353856 00000100:00100000:2.0:1789181622.627004:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385353856 00000100:00100000:0.0:1789181622.629169:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:0.0:1789181622.629183:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+13:15019:x1876092385353856:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789181622.629761:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+13:15019:x1876092385353856:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 576us (7549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181622.629771:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:2.0:1789181622.639651:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181622.642598:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385353984 00000100:00100000:0.0:1789181622.642616:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385353984 00000100:00100000:0.0:1789181622.642689:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:0.0:1789181622.642700:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+13:15030:x1876092385353984:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181622.642953:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+13:15030:x1876092385353984:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 254us (3311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181622.642962:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:2.0:1789181622.661059:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181622.666219:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385354112 00000100:00100000:1.0:1789181622.666598:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385354112 00000100:00100000:1.0:1789181622.666771:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:1.0:1789181622.666784:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+13:15030:x1876092385354112:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181622.666966:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+13:15030:x1876092385354112:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 185us (5917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181622.666975:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:2.0:1789181622.673074:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181622.673564:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385354240 00000100:00100000:1.0:1789181622.673574:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385354240 00000100:00100000:1.0:1789181622.673626:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1789181622.673635:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876092385354240:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789181622.673667:0:19683:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fcc207df-596b-4f70-b3cc-6ce500b568a0@192.168.202.1@tcp t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:1.0:1789181622.673705:0:19683:0:(genops.c:1384:class_connect()) connect: client fcc207df-596b-4f70-b3cc-6ce500b568a0, cookie 0x76fb55528351861c 00000004:00100000:1.0:1789181622.673867:0:19683:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789181622.673979:0:19683:0:(import.c:65:import_set_state_nolock()) ffff9c1cc45bf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181622.674111:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2392:x1876092385354240:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 476us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181622.674120:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1789181622.678767:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.678814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.678849:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.678879:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.678899:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.678923:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.678962:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181622.678989:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385355136 00000100:00100000:2.0:1789181622.679001:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385355136 00000100:00100000:2.0:1789181622.679049:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385355264 00000100:00100000:2.0:1789181622.679052:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385355264 00000100:00100000:2.0:1789181622.679073:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1789181622.679083:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2394:x1876092385355136:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181622.679165:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2394:x1876092385355136:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181622.679173:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1789181622.679189:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1789181622.679196:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385355264:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181622.679211:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385354496 00000100:00100000:3.0:1789181622.679216:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385354496 00000100:00100000:2.0:1789181622.679219:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385355264:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181622.679225:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:3.0:1789181622.679232:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385354752 00000100:00100000:3.0:1789181622.679234:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385354752 00000100:00100000:2.0:1789181622.679242:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385354880 00000100:00100000:2.0:1789181622.679245:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385354880 00000100:00100000:3.0:1789181622.679259:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385354368 00000100:00100000:2.0:1789181622.679259:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385355008 00000100:00100000:3.0:1789181622.679262:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385354368 00000100:00100000:2.0:1789181622.679271:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385355008 00000100:00100000:3.0:1789181622.679273:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:3.0:1789181622.679278:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:2394:x1876092385354880:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181622.679284:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:2.0:1789181622.679288:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2394:x1876092385355008:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181622.679321:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:2394:x1876092385354880:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 41us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181622.679321:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2394:x1876092385355008:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181622.679327:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:3.0:1789181622.684783:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1789181622.684822:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1789181622.684836:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1876092385354496:12345-192.168.202.1@tcp:38:mount.lustre.0 00000100:00100000:3.0:1789181622.684840:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1789181622.684855:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+7:15019:x1876092385354752:12345-192.168.202.1@tcp:41:mount.lustre.0 00010000:00080000:0.0:1789181622.684874:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from fcc207df-596b-4f70-b3cc-6ce500b568a0@192.168.202.1@tcp t0 exp 0000000000000000 cur 578 last 0 00000004:00000024:3.0:1789181622.684882:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000020:00000080:0.0:1789181622.684912:0:17147:0:(genops.c:1384:class_connect()) connect: client fcc207df-596b-4f70-b3cc-6ce500b568a0, cookie 0x76fb555283518623 00000004:00100000:0.0:1789181622.684936:0:17147:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789181622.684954:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+7:15019:x1876092385354752:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 108us (6141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181622.684961:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1789181622.684975:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1789181622.684980:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:0:x1876092385354368:12345-192.168.202.1@tcp:41:mount.lustre.0 00000100:00080000:0.0:1789181622.685037:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9c1dc467f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181622.685067:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2392:x1876092385354496:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 234us (6344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181622.685089:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00080000:0.0:1789181622.685259:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1789181622.686256:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789181622.686344:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:0:x1876092385354368:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 1360us (7378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181622.686354:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1789181622.690978:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181622.691340:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385355392 00000100:00100000:0.0:1789181622.691350:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385355392 00000100:00100000:0.0:1789181622.691649:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:0.0:1789181622.691661:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:15019:x1876092385355392:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789181622.691877:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:15019:x1876092385355392:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 217us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181622.691885:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1789181622.706660:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181622.707837:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385354624 00000100:00100000:1.0:1789181622.707850:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385354624 00000100:00100000:1.0:1789181622.707931:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1789181622.707941:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:0:x1876092385354624:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789181622.707973:0:19683:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789181622.708061:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:0:x1876092385354624:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 121us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181622.708069:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1789181622.708126:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181622.708263:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181622.708292:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181622.708341:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385355520 00000100:00100000:3.0:1789181622.708346:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385355520 00000100:00100000:3.0:1789181622.708368:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385355648 00000100:00100000:3.0:1789181622.708370:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385355648 00000100:00100000:3.0:1789181622.708386:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1789181622.708391:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1876092385355520:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789181622.708419:0:18978:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fcc207df-596b-4f70-b3cc-6ce500b568a0@192.168.202.1@tcp t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:3.0:1789181622.708448:0:18978:0:(genops.c:1384:class_connect()) connect: client fcc207df-596b-4f70-b3cc-6ce500b568a0, cookie 0x76fb55528351862a 00002000:00100000:3.0:1789181622.708461:0:18978:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fcc207df-596b-4f70-b3cc-6ce500b568a0/ffff9c1cc316a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789181622.708474:0:18978:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789181622.708569:0:18978:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789181622.708594:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385355776 00000100:00080000:3.0:1789181622.708598:0:18978:0:(import.c:65:import_set_state_nolock()) ffff9c1cc316f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181622.708599:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385355776 00000100:00100000:3.0:1789181622.708631:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2392:x1876092385355520:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 239us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181622.708634:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1789181622.708639:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1789181622.708641:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:15019:x1876092385355776:12345-192.168.202.1@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789181622.708651:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:3.0:1789181622.708654:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1876092385355648:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789181622.708668:0:18978:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fcc207df-596b-4f70-b3cc-6ce500b568a0@192.168.202.1@tcp t0 exp 0000000000000000 cur 578 last 0 00000100:00100000:1.0:1789181622.708671:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:15019:x1876092385355776:12345-192.168.202.1@tcp:900:mount.lustre.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181622.708678:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000020:00000080:3.0:1789181622.708699:0:18978:0:(genops.c:1384:class_connect()) connect: client fcc207df-596b-4f70-b3cc-6ce500b568a0, cookie 0x76fb555283518631 00002000:00100000:3.0:1789181622.708704:0:18978:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fcc207df-596b-4f70-b3cc-6ce500b568a0/ffff9c1cc316d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789181622.708710:0:18978:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789181622.708793:0:18978:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789181622.708807:0:18978:0:(import.c:65:import_set_state_nolock()) ffff9c1cc316e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181622.708831:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2392:x1876092385355648:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 174us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181622.708847:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00080000:0.0:1789181622.709266:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181622.718137:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181622.721316:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385355904 00000100:00100000:1.0:1789181622.721334:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385355904 00000100:00100000:1.0:1789181622.721405:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1789181622.721416:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:15019:x1876092385355904:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789181622.722124:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789181622.722367:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:15019:x1876092385355904:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 951us (4241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181622.722387:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00010000:00010000:2.0:1789181622.796816:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181623.052114:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408506880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181623.052348:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181623.052475:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408506880 00000100:00100000:0.0:1789181623.052485:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408506880 00000100:00100000:0.0:1789181623.052548:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789181623.052559:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408506880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789181623.052581:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789181623.052641:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408506880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181623.052649:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789181623.053715:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181623.056116:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408506880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789181623.061988:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181623.062817:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385356032 00000100:00100000:1.0:1789181623.062829:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385356032 00000100:00100000:1.0:1789181623.062895:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1789181623.062905:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:15053:x1876092385356032:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:1.0:1789181623.062925:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181623.062959:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283518638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df837b expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181623.063019:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181623.063034:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181623.063047:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181623.063174:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789181623.063178:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181623.063331:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181623.063356:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12800/0x76fb555283518638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df837b expref: 8 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181623.063374:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df837b expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181623.063397:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc7121300) 00010000:00010000:1.0:1789181623.063400:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181623.063403:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12000, rc 0) 00000100:00100000:1.0:1789181623.063519:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcc207df-596b-4f70-b3cc-6ce500b568a0+7:15053:x1876092385356032:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 616us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181623.063528:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:3.0:1789181623.824837:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181624.076013:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181624.076037:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408507008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181624.076157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181624.076767:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408507136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181624.076824:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181624.076849:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181624.076855:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408507264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181624.076876:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181624.076898:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181624.076905:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408507392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181624.076939:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181624.076967:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408507136 00000100:00100000:3.0:1789181624.076974:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408507136 00000100:00100000:3.0:1789181624.077024:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408507264 00000100:00100000:3.0:1789181624.077028:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408507264 00000100:00100000:3.0:1789181624.077045:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789181624.077164:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408507136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181624.077197:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789181624.077241:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408507136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181624.077249:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789181624.077266:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789181624.077273:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408507264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181624.077282:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789181624.077345:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408507264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181624.077352:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789181624.077376:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408507008 00000100:00100000:3.0:1789181624.077506:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408507008 00000100:00100000:3.0:1789181624.077548:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408507392 00000100:00100000:3.0:1789181624.077552:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408507392 00000100:00100000:3.0:1789181624.077567:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789181624.077573:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408507008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181624.077597:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789181624.077630:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408507008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181624.077636:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789181624.077647:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789181624.077653:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408507392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181624.077669:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789181624.077693:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408507392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181624.077699:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789181624.077715:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181624.077743:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408507520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181624.077768:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181624.077806:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408507392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181624.077839:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408507264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181624.077847:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789181624.077861:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408507136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181624.077898:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408507008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181624.077914:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408507520 00000100:00100000:3.0:1789181624.077917:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408507520 00000100:00100000:3.0:1789181624.079276:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789181624.079298:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408507520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181624.079325:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789181624.079397:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408507520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181624.079405:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789181624.079427:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181624.079795:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408507520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181624.080146:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408507776:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.080202:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181624.080231:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408508288:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.080253:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181624.080275:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789181624.080281:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408507648:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.080321:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181624.080349:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408508160:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.080369:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181624.080412:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408507776 00000100:00100000:2.0:1789181624.080418:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408507776 00000100:00100000:2.0:1789181624.080587:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408508288 00000100:00100000:2.0:1789181624.080591:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408508288 00000100:00100000:2.0:1789181624.080613:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408508160 00000100:00100000:2.0:1789181624.080615:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408508160 00000100:00100000:2.0:1789181624.080630:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789181624.080637:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408507776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.080694:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408507776:12345-0@lo:400:kworker.0 Request processed in 57us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181624.080702:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789181624.080716:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789181624.080746:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408508288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.080776:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408508288:12345-0@lo:400:kworker.0 Request processed in 54us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181624.080782:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789181624.080794:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181624.080800:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408508160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.080844:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408508160:12345-0@lo:400:kworker.0 Request processed in 44us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181624.080851:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181624.080872:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408507648 00000100:00100000:2.0:1789181624.080876:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408507648 00000100:00100000:2.0:1789181624.080944:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789181624.080951:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+24:3646:x1876092408507648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.080979:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+24:3646:x1876092408507648:12345-0@lo:400:kworker.0 Request processed in 29us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181624.080985:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789181624.081029:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408507648:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.081041:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408508160:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.081062:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408507776:0@lo:400:kworker.0 00010000:00080000:2.0:1789181624.081073:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093ed80 x1876092408508288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181624.081089:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408508288:0@lo:400:kworker.0 00000100:00080000:2.0:1789181624.081110:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181624.081113:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181624.081122:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408507904:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.081150:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181624.081169:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408508416:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.081191:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181624.081205:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789181624.081211:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408508032:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.081236:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181624.081252:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408508544:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.081270:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181624.081303:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408507904 00000100:00100000:2.0:1789181624.081307:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408507904 00000100:00100000:2.0:1789181624.081331:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789181624.081338:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408507904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.081370:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408507904:12345-0@lo:400:kworker.0 Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181624.081376:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789181624.081389:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408508416 00000100:00100000:2.0:1789181624.081392:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408508416 00000100:00100000:2.0:1789181624.081413:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408508032 00000100:00100000:2.0:1789181624.081415:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408508032 00000100:00100000:2.0:1789181624.081425:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408508544 00000100:00100000:2.0:1789181624.081427:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408508544 00000100:00100000:2.0:1789181624.081438:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181624.085680:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408508416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.085789:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408508416:12345-0@lo:400:kworker.0 Request processed in 122us (4595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181624.085797:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181624.085832:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789181624.085840:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408508032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.085868:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408508032:12345-0@lo:400:kworker.0 Request processed in 30us (4631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181624.085875:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789181624.085886:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789181624.085893:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408508544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.085922:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408508544:12345-0@lo:400:kworker.0 Request processed in 29us (4651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181624.085927:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789181624.085966:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181624.085971:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181624.086008:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408508032:0@lo:400:kworker.0 00010000:00080000:2.0:1789181624.086024:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1e0093d880 x1876092408508544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181624.086034:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408508544:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.086058:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408507904:0@lo:400:kworker.0 00000100:00100000:2.0:1789181624.086070:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408508416:0@lo:400:kworker.0 00010000:00010000:1.0:1789181624.844237:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181624.913371:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789181625.868839:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789181626.128197:0:17125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fcc207df-596b-4f70-b3cc-6ce500b568a0 00000001:00100000:2.0:1789181626.128225:0:17125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c5862b8c-2b27-4ce8-9320-ff219707bd0a 00000001:00100000:2.0:1789181626.131159:0:17877:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fcc207df-596b-4f70-b3cc-6ce500b568a0 00000001:00100000:2.0:1789181626.131172:0:17877:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c5862b8c-2b27-4ce8-9320-ff219707bd0a 00000001:00100000:0.0:1789181626.134612:0:18647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fcc207df-596b-4f70-b3cc-6ce500b568a0 00000001:00100000:0.0:1789181626.134624:0:18647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5862b8c-2b27-4ce8-9320-ff219707bd0a 00000001:02000400:3.0:1789181626.436334:0:20022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789181626.892162:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181627.754640:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181627.754681:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181627.754709:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181627.754757:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181627.754775:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181627.754790:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181627.754809:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181627.754828:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181627.754855:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181627.754880:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385356288 00000100:00100000:2.0:1789181627.754892:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385356288 00000100:00100000:2.0:1789181627.754945:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385356416 00000100:00100000:2.0:1789181627.754948:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385356416 00000100:00100000:2.0:1789181627.754961:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385356800 00000100:00100000:2.0:1789181627.754963:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385356800 00000100:00100000:2.0:1789181627.754976:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385356928 00000100:00100000:2.0:1789181627.754978:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385356928 00000100:00100000:2.0:1789181627.754993:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1789181627.755003:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2393:x1876092385356288:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181627.755084:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2393:x1876092385356288:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 81us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.755091:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1789181627.755109:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1789181627.755115:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385356416:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181627.755161:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385356416:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 46us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.755168:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:2.0:1789181627.755181:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1789181627.755188:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2393:x1876092385356800:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181627.755211:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2393:x1876092385356800:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.755217:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:2.0:1789181627.755229:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1789181627.755235:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2394:x1876092385356928:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181627.755268:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2394:x1876092385356928:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.755273:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1789181627.755300:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385356544 00000100:00100000:2.0:1789181627.755303:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385356544 00000100:00100000:1.0:1789181627.755434:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385356160 00000100:00100000:1.0:1789181627.755439:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385356160 00000100:00100000:1.0:1789181627.755470:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:1.0:1789181627.755477:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+13:2394:x1876092385356160:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1789181627.755506:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+13:2394:x1876092385356160:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 30us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181627.755512:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 147 00000100:00100000:2.0:1789181627.755823:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385356672 00000100:00100000:2.0:1789181627.755828:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385356672 00000100:00100000:2.0:1789181627.755847:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385357056 00000100:00100000:2.0:1789181627.755850:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385357056 00000100:00100000:2.0:1789181627.755862:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385357184 00000100:00100000:2.0:1789181627.755864:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385357184 00000100:00100000:2.0:1789181627.755878:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1789181627.755884:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2393:x1876092385356544:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181627.755915:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2393:x1876092385356544:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.755934:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1789181627.755947:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1789181627.755953:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385356672:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181627.755982:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385356672:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 29us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.755988:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1789181627.755997:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1789181627.756003:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2393:x1876092385357056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181627.756024:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2393:x1876092385357056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.756029:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1789181627.756038:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1789181627.756044:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2394:x1876092385357184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181627.756060:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2394:x1876092385357184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 17us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.756066:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00080000:2.0:1789181627.756086:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181627.756090:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181627.756093:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181627.756095:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789181627.916441:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181628.176472:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408508672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789181628.176592:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181628.179360:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408508672 00000100:00100000:2.0:1789181628.179380:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408508672 00000100:00100000:2.0:1789181628.179499:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789181628.179513:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408508672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789181628.179576:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789181628.179688:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408508672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 179us (3096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181628.179696:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789181628.179800:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408508672:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789181628.180228:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789181628.941765:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181629.196721:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408508800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181629.196809:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181629.196862:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408509312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181629.196885:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181629.196909:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181629.196915:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408509184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181629.196933:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181629.196961:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408508928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181629.197021:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181629.197049:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181629.197054:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408509056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789181629.197098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181629.197126:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408509312 00000100:00100000:3.0:1789181629.197133:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408509312 00000100:00100000:3.0:1789181629.197182:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408508928 00000100:00100000:3.0:1789181629.197185:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408508928 00000100:00100000:3.0:1789181629.197197:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408509056 00000100:00100000:3.0:1789181629.197199:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408509056 00000100:00100000:3.0:1789181629.197215:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789181629.197223:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408509312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181629.197258:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789181629.197310:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408509312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181629.197317:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789181629.197333:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789181629.197339:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408508928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181629.197358:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789181629.197388:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408508928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181629.197395:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789181629.197406:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789181629.197412:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408509056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789181629.197421:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789181629.197444:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408509056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181629.197450:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789181629.197467:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408508800 00000100:00100000:3.0:1789181629.197471:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408508800 00000100:00100000:0.0:1789181629.197578:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408509184 00000100:00100000:0.0:1789181629.197592:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408509184 00000100:00100000:0.0:1789181629.197644:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789181629.197650:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408509184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789181629.197672:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789181629.197707:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408509184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181629.197712:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789181629.197984:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789181629.198283:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408508800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181629.198528:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789181629.198584:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408508800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 593us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181629.198591:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789181629.198677:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181629.198682:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181629.198797:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408509056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181629.198813:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408508928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181629.198877:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408509184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181629.198895:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408508800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181629.198909:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc384a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408509312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181629.199593:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408509696:0@lo:400:kworker.0 00000100:00100000:2.0:1789181629.199646:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181629.199677:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408510208:0@lo:400:kworker.0 00000100:00100000:2.0:1789181629.199704:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181629.199744:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789181629.199751:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408509824:0@lo:400:kworker.0 00000100:00100000:2.0:1789181629.199775:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181629.199794:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408510336:0@lo:400:kworker.0 00000100:00100000:3.0:1789181629.199798:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408509440:0@lo:400:kworker.0 00000100:00100000:2.0:1789181629.199821:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181629.199843:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181629.199857:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408509696 00000100:00100000:2.0:1789181629.199864:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408509696 00000100:00100000:3.0:1789181629.199881:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408509952:0@lo:400:kworker.0 00000100:00100000:2.0:1789181629.199909:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789181629.199914:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181629.199921:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408509696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181629.199936:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789181629.199956:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1e0093ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408509568:0@lo:400:kworker.0 00000100:00100000:3.0:1789181629.200008:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181629.200020:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408510080:0@lo:400:kworker.0 00000100:00100000:3.0:1789181629.200049:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181629.200446:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408510208 00000100:00100000:0.0:1789181629.200451:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408510208 00000100:00100000:0.0:1789181629.200486:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408509824 00000100:00100000:0.0:1789181629.200489:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408509824 00000100:00100000:0.0:1789181629.200499:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408510336 00000100:00100000:0.0:1789181629.200501:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408510336 00000100:00100000:0.0:1789181629.200510:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408509952 00000100:00100000:0.0:1789181629.200512:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408509952 00000100:00100000:0.0:1789181629.200521:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408509568 00000100:00100000:0.0:1789181629.200523:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408509568 00000100:00100000:0.0:1789181629.200530:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408510080 00000100:00100000:0.0:1789181629.200532:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408510080 00000100:00100000:0.0:1789181629.200542:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789181629.200548:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408510208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181629.200616:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408509696:12345-0@lo:400:kworker.0 Request processed in 696us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181629.200625:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789181629.200654:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789181629.200662:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408509824:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789181629.200841:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181629.200844:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181629.201010:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876092408510208:12345-0@lo:400:kworker.0 Request processed in 461us (1304us total) trans 0 rc 0/0 00000001:00100000:3.0:1789181629.201163:0:19466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fcc207df-596b-4f70-b3cc-6ce500b568a0 00000100:00100000:0.0:1789181629.201190:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789181629.201207:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789181629.201214:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408510336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181629.201258:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876092408510336:12345-0@lo:400:kworker.0 Request processed in 45us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181629.201273:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789181629.201284:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789181629.201289:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408509952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181629.201423:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876092408509952:12345-0@lo:400:kworker.0 Request processed in 134us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181629.201429:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789181629.201441:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789181629.201447:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408509568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181629.201484:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876092408509568:12345-0@lo:400:kworker.0 Request processed in 28us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181629.201490:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789181629.201501:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789181629.201508:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408510080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181629.201534:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876092408510080:12345-0@lo:400:kworker.0 Request processed in 27us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181629.201540:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789181629.201824:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1876092408509952:0@lo:400:kworker.0 00000100:00100000:3.0:1789181629.201853:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876092408509568:0@lo:400:kworker.0 00010000:00080000:3.0:1789181629.201864:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd8ba2d80 x1876092408510080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181629.201874:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1876092408510080:0@lo:400:kworker.0 00000100:00100000:2.0:1789181629.207709:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876092408509824:12345-0@lo:400:kworker.0 Request processed in 6934us (7819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181629.207768:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789181629.207825:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408509440 00000100:00100000:2.0:1789181629.207835:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408509440 00000100:00100000:2.0:1789181629.210859:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789181629.211124:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+24:3643:x1876092408509440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181629.211236:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+24:3643:x1876092408509440:12345-0@lo:400:kworker.0 Request processed in 364us (11392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181629.211256:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789181629.217855:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876092408509824:0@lo:400:kworker.0 00010000:00080000:3.0:1789181629.217879:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dd8ba3800 x1876092408510336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181629.217889:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1876092408510336:0@lo:400:kworker.0 00000100:00100000:3.0:1789181629.217903:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408509696:0@lo:400:kworker.0 00000100:00100000:3.0:1789181629.217913:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1876092408510208:0@lo:400:kworker.0 00000100:00100000:2.0:1789181629.219451:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1e0093ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408509440:0@lo:400:kworker.0 00010000:00010000:3.0:1789181629.969170:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181630.353607:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1789181630.557102:0:20170:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7ad12f30 20000000:00000080:2.0:1789181630.557122:0:20170:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c1dc46a8c00 uarg=0000000000000000 20000000:01000000:2.0:1789181630.557174:0:20170:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789181630.557180:0:20170:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789181630.557186:0:20170:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789181630.559103:0:20171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1789181630.559269:0:20170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789181630.575951:0:20170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789181630.575988:0:20170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576012:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0085fa00/0x76fb5552835182db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835182d4 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576021:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0084a800/0x76fb5552835182e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb5552835182e2 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576049:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1cc39f0400/0x76fb555283518328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518321 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576056:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1e0085e600/0x76fb55528351848d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518486 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576066:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1679400/0x76fb5552835185d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82da expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576073:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c1dc1678a00/0x76fb555283518615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df834a expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576081:0:20170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576132:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1678a00/0x76fb555283518615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df834a expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576151:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1dc1678a00/0x76fb555283518615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df834a expref: 12 pid: 17139 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.576167:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408510464:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181630.576296:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1dc1679400/0x76fb5552835185d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82da expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576306:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1dc1679400/0x76fb5552835185d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82da expref: 12 pid: 17140 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.576315:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408510592:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181630.576357:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0085e600/0x76fb55528351848d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283518486 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576366:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0085e600/0x76fb55528351848d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283518486 expref: 23 pid: 17139 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.576376:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408510720:0@lo:104: 00000100:00100000:1.0:1789181630.576421:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181630.576457:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1cc39f0400/0x76fb555283518328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb555283518321 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576466:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1cc39f0400/0x76fb555283518328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb555283518321 expref: 23 pid: 17140 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.576474:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408510848:0@lo:104: 00000100:00100000:1.0:1789181630.576495:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181630.576533:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0084a800/0x76fb5552835182e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb5552835182e2 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576542:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0084a800/0x76fb5552835182e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb5552835182e2 expref: 23 pid: 17138 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.576549:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3209500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408510976:0@lo:104: 00000100:00100000:1.0:1789181630.576569:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181630.576587:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c1e0085fa00/0x76fb5552835182db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x76fb5552835182d4 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.576595:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c1e0085fa00/0x76fb5552835182db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x76fb5552835182d4 expref: 23 pid: 17138 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.576614:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408511104:0@lo:104: 00000100:00100000:2.0:1789181630.576635:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408510720 00000100:00100000:1.0:1789181630.576636:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181630.576644:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408510720 00000100:00100000:1.0:1789181630.576646:0:20170:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6880900 going to sleep for 11 seconds 00000100:00100000:2.0:1789181630.576690:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408510848 00000100:00100000:2.0:1789181630.576693:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408510848 00000100:00100000:2.0:1789181630.576704:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408510976 00000100:00100000:2.0:1789181630.576705:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408510976 00000100:00100000:2.0:1789181630.576712:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408511104 00000100:00100000:2.0:1789181630.576713:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408511104 00000100:00100000:2.0:1789181630.576746:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789181630.576757:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+6:20170:x1876092408510720:12345-0@lo:104: 00010000:00010000:2.0:1789181630.576770:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.576842:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789181630.576849:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+6:20170:x1876092408510720:12345-0@lo:104: Request processed in 94us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181630.576856:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789181630.576876:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789181630.576882:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+5:20170:x1876092408510848:12345-0@lo:104: 00010000:00010000:2.0:1789181630.576889:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.576923:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789181630.576927:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+5:20170:x1876092408510848:12345-0@lo:104: Request processed in 46us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181630.576932:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789181630.576945:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181630.576950:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+4:20170:x1876092408510976:12345-0@lo:104: 00010000:00010000:2.0:1789181630.576957:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.576988:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789181630.576993:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+4:20170:x1876092408510976:12345-0@lo:104: Request processed in 43us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181630.576998:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181630.577008:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789181630.577014:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+3:20170:x1876092408511104:12345-0@lo:104: 00010000:00010000:2.0:1789181630.577020:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577052:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789181630.577056:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:868df35c-3970-416b-9e25-2e3d68c8633a+3:20170:x1876092408511104:12345-0@lo:104: Request processed in 44us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181630.577062:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789181630.577080:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789181630.577086:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577093:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522c00 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181630.577098:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577106:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181630.577113:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181630.577119:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181630.577148:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577155:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181630.577173:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577180:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522c00/0x76fb555283518486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb55528351848d expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577204:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789181630.577208:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577214:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13200 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181630.577216:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577222:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181630.577464:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181630.577470:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181630.577486:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577492:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181630.577499:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577506:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1de0b13200/0x76fb555283518321 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb555283518328 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577516:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181630.577519:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577536:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f400 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181630.577540:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577547:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181630.577553:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181630.577559:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181630.577573:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577580:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181630.577592:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577599:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f400/0x76fb5552835182e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182e9 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577609:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181630.577611:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577616:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0085f000 already unused, calling callback (ffffffffc13aac20) 10000000:00010000:2.0:1789181630.577619:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577636:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181630.577643:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181630.577648:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181630.577661:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577667:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181630.577672:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577678:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff9c1e0085f000/0x76fb5552835182d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x76fb5552835182db expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.577692:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181630.577694:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181630.577696:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181630.577718:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408511232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181630.577794:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181630.577826:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181630.577832:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408511360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181630.577851:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181630.577887:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408511232 00000100:00100000:2.0:1789181630.577893:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408511232 00010000:00010000:2.0:1789181630.577913:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0085e600/0x76fb55528351848d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283518486 expref: 24 pid: 17139 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181630.577944:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408511360 00000100:00100000:2.0:1789181630.577948:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408511360 00010000:00010000:2.0:1789181630.577959:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1cc39f0400/0x76fb555283518328 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283518321 expref: 25 pid: 17140 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181630.577975:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789181630.577981:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:868df35c-3970-416b-9e25-2e3d68c8633a+25:3643:x1876092408511232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181630.577993:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181630.577998:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0085e600/0x76fb55528351848d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283518486 expref: 25 pid: 17139 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.578006:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0085e600/0x76fb55528351848d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283518486 expref: 25 pid: 17139 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.578020:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181630.578050:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:868df35c-3970-416b-9e25-2e3d68c8633a+25:3643:x1876092408511232:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181630.578056:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789181630.578067:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789181630.578072:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:868df35c-3970-416b-9e25-2e3d68c8633a+24:3643:x1876092408511360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181630.578079:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181630.578083:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1cc39f0400/0x76fb555283518328 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb555283518321 expref: 24 pid: 17140 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.578091:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1cc39f0400/0x76fb555283518328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb555283518321 expref: 24 pid: 17140 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.578100:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181630.578124:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:868df35c-3970-416b-9e25-2e3d68c8633a+24:3643:x1876092408511360:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181630.578130:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789181630.578161:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408511360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181630.578168:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:868df35c-3970-416b-9e25-2e3d68c8633a:3643:1876092408511232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181630.578429:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181630.578775:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181630.578791:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408511488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181630.578836:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181630.578868:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181630.578874:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408511616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181630.578893:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181630.578992:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408511488 00000100:00100000:3.0:1789181630.578998:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408511488 00010000:00010000:3.0:1789181630.579020:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0084a800/0x76fb5552835182e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835182e2 expref: 24 pid: 17138 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181630.579037:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408511616 00000100:00100000:3.0:1789181630.579040:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408511616 00010000:00010000:3.0:1789181630.579061:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1e0085fa00/0x76fb5552835182db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835182d4 expref: 25 pid: 17138 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181630.579075:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181630.579081:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:868df35c-3970-416b-9e25-2e3d68c8633a+25:3645:x1876092408511488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181630.579090:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181630.579094:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0084a800/0x76fb5552835182e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835182e2 expref: 25 pid: 17138 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.579101:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0084a800/0x76fb5552835182e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb5552835182e2 expref: 25 pid: 17138 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.579113:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181630.579143:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:868df35c-3970-416b-9e25-2e3d68c8633a+25:3645:x1876092408511488:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.579149:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181630.579163:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181630.579169:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:868df35c-3970-416b-9e25-2e3d68c8633a+24:3645:x1876092408511616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181630.579177:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181630.579181:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1e0085fa00/0x76fb5552835182db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x76fb5552835182d4 expref: 24 pid: 17138 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.579189:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1e0085fa00/0x76fb5552835182db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x76fb5552835182d4 expref: 24 pid: 17138 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.579206:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181630.579238:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:868df35c-3970-416b-9e25-2e3d68c8633a+24:3645:x1876092408511616:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.579245:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789181630.579315:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408511616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181630.579321:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408511488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181630.581410:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181630.581447:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181630.581581:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385357312 00000100:00100000:0.0:1789181630.581590:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385357312 00010000:00010000:0.0:1789181630.581625:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1678a00/0x76fb555283518615 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df834a expref: 13 pid: 17139 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181630.581662:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385357440 00000100:00100000:0.0:1789181630.581666:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385357440 00010000:00010000:0.0:1789181630.581679:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c1dc1679400/0x76fb5552835185d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82da expref: 14 pid: 17140 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181630.581715:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1789181630.581747:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff940c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bec7f81-b22c-449b-9b54-80d117d39796+14:2393:x1876092385357312:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181630.581764:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181630.581770:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1678a00/0x76fb555283518615 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df834a expref: 14 pid: 17139 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.581780:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1678a00/0x76fb555283518615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df834a expref: 14 pid: 17139 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.581798:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181630.581867:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff940c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bec7f81-b22c-449b-9b54-80d117d39796+14:2393:x1876092385357312:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 144us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181630.581875:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1789181630.581925:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1789181630.581932:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bec7f81-b22c-449b-9b54-80d117d39796+13:2394:x1876092385357440:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181630.581941:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181630.581945:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c1dc1679400/0x76fb5552835185d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82da expref: 13 pid: 17140 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.581954:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c1dc1679400/0x76fb5552835185d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82da expref: 13 pid: 17140 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.581966:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.581975:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.581997:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.582005:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.582011:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.582019:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.582024:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181630.582028:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.582036:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.582046:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181630.582056:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181630.582078:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7bec7f81-b22c-449b-9b54-80d117d39796+13:2394:x1876092385357440:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 145us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181630.582084:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00010000:00010000:1.0:1789181630.583294:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1678a00/0x76fb555283518615 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df834a expref: 12 pid: 17139 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.583314:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408510464:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181630.583326:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1dc1679400/0x76fb5552835185d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df82da expref: 11 pid: 17140 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.583335:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408510592:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181630.583348:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085e600/0x76fb55528351848d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283518486 expref: 23 pid: 17139 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.583776:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408510720:0@lo:104: 00010000:00010000:1.0:1789181630.583793:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1cc39f0400/0x76fb555283518328 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb555283518321 expref: 22 pid: 17140 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.583800:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408510848:0@lo:104: 00010000:00010000:1.0:1789181630.583811:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0084a800/0x76fb5552835182e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb5552835182e2 expref: 21 pid: 17138 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.583819:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3209500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408510976:0@lo:104: 00010000:00010000:1.0:1789181630.583829:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1e0085fa00/0x76fb5552835182db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x76fb5552835182d4 expref: 20 pid: 17138 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181630.583836:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1876092408511104:0@lo:104: 00010000:00010000:1.0:1789181630.583879:0:20170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.583889:0:20170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.583895:0:20170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.583902:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c1de0b12400/0x76fb555283518646 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181630.987924:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789181631.948587:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181631.948598:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1df27eb800 from 13 10000000:01000000:2.0:1789181631.948604:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181631.948670:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351864d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181631.948684:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351864d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181631.948698:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351864d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181631.948770:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408511744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181631.948854:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181631.948898:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd82bf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181631.949134:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408511744 00000100:00100000:3.0:1789181631.949144:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408511744 00000100:00100000:3.0:1789181631.949203:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789181631.949213:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+20:17142:x1876092408511744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181631.949237:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181631.949252:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658a800/0x76fb555283518654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351864d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181631.949278:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658a800/0x76fb555283518654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351864d expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181631.949290:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658a800/0x76fb555283518654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351864d expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181631.949300:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658a800, rc 0) 00000100:00100000:3.0:1789181631.949361:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:17142:x1876092408511744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181631.949368:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789181631.950103:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408511744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181631.950121:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351864d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518654 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181631.950149:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351864d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518654 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181631.950229:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408511872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181631.950263:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181631.950295:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1eb0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181631.950348:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408511872 00000100:00100000:2.0:1789181631.950353:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408511872 00000100:00100000:2.0:1789181631.950379:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789181631.950386:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+21:17142:x1876092408511872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181631.950501:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+21:17142:x1876092408511872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181631.950513:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789181631.950618:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408511872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181631.950642:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181631.950675:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181631.950695:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1eb0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181631.950752:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408512000 00000100:00100000:3.0:1789181631.950756:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408512000 00000100:00100000:3.0:1789181631.950782:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789181631.950787:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:17142:x1876092408512000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181631.950859:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:17142:x1876092408512000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181631.950866:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789181631.951440:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789181631.953924:0:20222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789181631.956145:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789181631.956192:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181631.956205:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351864d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518654 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181631.956235:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522a00/0x76fb55528351864d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518654 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181631.956248:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789181631.956252:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1df3d93800 from 13 10000000:01000000:0.0:1789181631.956256:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789181631.956309:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb55528351865b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181631.956318:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb55528351865b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181631.956353:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb55528351865b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181631.956381:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181631.956449:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181631.956494:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1eb0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789181631.956514:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408512128 00000100:00100000:0.0:1789181631.956521:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408512128 00000100:00100000:0.0:1789181631.956571:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789181631.956580:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+21:17142:x1876092408512128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181631.956595:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181631.956607:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc1679a00/0x76fb555283518662 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb55528351865b expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181631.956634:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc1679a00/0x76fb555283518662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb55528351865b expref: 22 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181631.956645:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc1679a00/0x76fb555283518662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb55528351865b expref: 22 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181631.956654:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679a00, rc 0) 00000100:00100000:0.0:1789181631.956690:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+22:17142:x1876092408512128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181631.956697:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789181631.956887:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181631.956901:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb55528351865b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518662 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181631.956917:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb55528351865b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518662 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181631.957769:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181631.957817:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181631.957851:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1eb0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181631.959114:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408512256 00000100:00100000:2.0:1789181631.959125:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408512256 00000100:00100000:2.0:1789181631.959177:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789181631.959188:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+22:17142:x1876092408512256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181631.959367:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+22:17142:x1876092408512256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181631.959375:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789181631.961287:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181631.961370:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181631.961494:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181631.961546:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd12ab000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181631.961672:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408512384 00000100:00100000:0.0:1789181631.961680:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408512384 00000100:00100000:0.0:1789181631.961766:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789181631.961777:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+22:17142:x1876092408512384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181631.961891:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+22:17142:x1876092408512384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181631.961900:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789181631.962004:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3896d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789181631.964278:0:20223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789181631.965234:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789181631.965261:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181631.965273:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb55528351865b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518662 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181631.965284:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1679000/0x76fb55528351865b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518662 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181631.965295:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181631.965298:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1dc6df7800 from 13 10000000:01000000:2.0:1789181631.965301:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181631.965358:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283518669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181631.965367:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283518669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181631.965377:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283518669 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181631.965406:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181631.965497:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181631.965548:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd82bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181631.965657:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408512512 00000100:00100000:3.0:1789181631.965665:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408512512 00000100:00100000:3.0:1789181631.965719:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789181631.965749:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+22:17142:x1876092408512512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181631.965762:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181631.965775:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658b800/0x76fb555283518670 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283518669 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181631.965799:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658b800/0x76fb555283518670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283518669 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181631.965811:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658b800/0x76fb555283518670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518669 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181631.965820:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b800, rc 0) 00000100:00100000:3.0:1789181631.965862:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+23:17142:x1876092408512512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181631.965869:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789181631.966123:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181631.966141:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283518669 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518670 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181631.966150:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283518669 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb555283518670 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181631.966213:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181631.966255:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181631.966287:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6880900 going to sleep for 11 seconds 00000100:00100000:3.0:1789181631.966349:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408512640 00000100:00100000:3.0:1789181631.966353:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408512640 00000100:00100000:3.0:1789181631.966386:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789181631.966394:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:17142:x1876092408512640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181631.966511:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:17142:x1876092408512640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181631.966527:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789181631.967156:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181631.967199:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181631.967262:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181631.967289:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6880900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181631.967305:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408512768 00000100:00100000:1.0:1789181631.967309:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408512768 00000100:00100000:1.0:1789181631.967414:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789181631.967424:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:17142:x1876092408512768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181631.967515:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:17142:x1876092408512768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181631.967522:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789181631.967567:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789181631.970670:0:20224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789181631.970803:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789181631.970826:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789181631.970840:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283518669 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518670 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181631.970854:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1dc1522800/0x76fb555283518669 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb555283518670 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181631.970865:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789181631.970868:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c1cc44fb800 from 13 10000000:01000000:1.0:1789181631.970871:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789181631.970935:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12400/0x76fb555283518677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181631.970944:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12400/0x76fb555283518677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181631.970958:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12400/0x76fb555283518677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181631.970998:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181631.971070:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181631.971126:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6880480 going to sleep for 11 seconds 00000100:00100000:1.0:1789181631.971146:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408512896 00000100:00100000:1.0:1789181631.971153:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408512896 00000100:00100000:1.0:1789181631.971201:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789181631.971211:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+23:17142:x1876092408512896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181631.971236:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181631.971249:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1de0b12800/0x76fb55528351867e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x76fb555283518677 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181631.971274:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1de0b12800/0x76fb55528351867e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x76fb555283518677 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181631.971285:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1de0b12800/0x76fb55528351867e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x76fb555283518677 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181631.971294:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12800, rc 0) 00000100:00100000:1.0:1789181631.971329:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:868df35c-3970-416b-9e25-2e3d68c8633a+24:17142:x1876092408512896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181631.971337:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789181631.971383:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408512896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181631.971399:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12400/0x76fb555283518677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351867e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181631.971408:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12400/0x76fb555283518677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x76fb55528351867e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181631.971459:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408513024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181631.971484:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181631.971507:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6880480 going to sleep for 11 seconds 00000100:00100000:1.0:1789181631.971520:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408513024 00000100:00100000:1.0:1789181631.971524:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408513024 00000100:00100000:1.0:1789181631.971544:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789181631.971550:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:17142:x1876092408513024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181631.971656:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:17142:x1876092408513024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181631.971664:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789181631.971693:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408513024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181631.971717:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408513152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181631.971782:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181631.971795:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dc6880480 going to sleep for 11 seconds 00000100:00100000:1.0:1789181631.971808:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408513152 00000100:00100000:1.0:1789181631.971811:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408513152 00000100:00100000:1.0:1789181631.971832:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789181631.971838:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+24:17142:x1876092408513152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181631.971913:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:868df35c-3970-416b-9e25-2e3d68c8633a+24:17142:x1876092408513152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181631.971920:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789181631.971967:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:868df35c-3970-416b-9e25-2e3d68c8633a:17142:1876092408513152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789181631.972592:0:20225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789181631.972632:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789181631.972647:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789181631.972654:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12400/0x76fb555283518677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351867e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181631.972676:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff9c1de0b12400/0x76fb555283518677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x76fb55528351867e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181632.017015:0:12308:0:(ldlm_pool.c:1330:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:0.0:1789181632.022166:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181632.556862:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181632.556976:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385357568 00000100:00100000:1.0:1789181632.556992:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385357568 00000100:00100000:1.0:1789181632.557064:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:1.0:1789181632.557074:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+11:14903:x1876092385357568:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181632.557092:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181632.557110:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1de0b12200/0x76fb555283518685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8382 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181632.557141:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1de0b12200/0x76fb555283518685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8382 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181632.557154:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1de0b12200/0x76fb555283518685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8382 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181632.557163:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12200, rc 0) 00000100:00100000:1.0:1789181632.557235:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+12:14903:x1876092385357568:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 162us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181632.557243:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 161 00000100:00100000:2.0:1789181632.570686:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181632.570824:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385357696 00000100:00100000:1.0:1789181632.570836:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385357696 00000100:00100000:1.0:1789181632.570897:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:1.0:1789181632.570909:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+12:14903:x1876092385357696:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181632.571069:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+12:14903:x1876092385357696:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 162us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181632.571090:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:3.0:1789181632.588688:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181632.589045:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385357824 00000100:00100000:3.0:1789181632.589057:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385357824 00000100:00100000:3.0:1789181632.589124:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1789181632.589135:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4c07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+12:14903:x1876092385357824:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181632.589317:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4c07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+12:14903:x1876092385357824:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 184us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181632.589326:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1789181632.612333:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181632.612386:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385357952 00000100:00100000:3.0:1789181632.612398:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385357952 00000100:00100000:3.0:1789181632.612455:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1789181632.612466:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+12:14903:x1876092385357952:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181632.612485:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181632.612503:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c1dc658b200/0x76fb55528351868c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8389 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181632.612538:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c1dc658b200/0x76fb55528351868c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8389 expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181632.612550:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c1dc658b200/0x76fb55528351868c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8389 expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181632.612561:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b200, rc 0) 00000100:00100000:3.0:1789181632.612624:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+13:14903:x1876092385357952:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 160us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181632.612641:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:3.0:1789181632.619112:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181632.626513:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385358080 00000100:00100000:1.0:1789181632.626532:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385358080 00000100:00100000:1.0:1789181632.626597:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:1.0:1789181632.626609:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+13:14903:x1876092385358080:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181632.626873:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7bec7f81-b22c-449b-9b54-80d117d39796+13:14903:x1876092385358080:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 190us (7695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181632.626882:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:1.0:1789181632.637718:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181632.638095:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385358208 00000100:00100000:3.0:1789181632.638107:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385358208 00000100:00100000:3.0:1789181632.638168:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:3.0:1789181632.638179:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+13:14903:x1876092385358208:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181632.638339:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+13:14903:x1876092385358208:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 161us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181632.638347:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:2.0:1789181632.871174:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181632.871230:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181632.871255:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181632.871279:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181632.871302:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181632.871320:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181632.871341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181632.871360:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181632.871380:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181632.871412:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385358464 00000100:00100000:2.0:1789181632.871423:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385358464 00000100:00100000:2.0:1789181632.871482:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385358976 00000100:00100000:2.0:1789181632.871485:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385358976 00000100:00100000:2.0:1789181632.871499:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385358592 00000100:00100000:2.0:1789181632.871501:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385358592 00000100:00100000:2.0:1789181632.871514:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385359104 00000100:00100000:2.0:1789181632.871515:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385359104 00000100:00100000:2.0:1789181632.871530:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1789181632.871540:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2394:x1876092385358464:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181632.871618:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2394:x1876092385358464:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 79us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181632.871625:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1789181632.871644:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1789181632.871650:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2394:x1876092385358976:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181632.871690:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2394:x1876092385358976:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 40us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181632.871696:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1789181632.871709:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1789181632.871715:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385358592:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181632.871774:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385358592:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 59us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181632.871780:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1789181632.871791:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1789181632.871797:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2394:x1876092385359104:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181632.871820:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2394:x1876092385359104:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181632.871825:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:2.0:1789181632.871843:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385358720 00000100:00100000:2.0:1789181632.871846:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385358720 00000100:00100000:2.0:1789181632.871864:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385359232 00000100:00100000:2.0:1789181632.871867:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385359232 00000100:00100000:2.0:1789181632.871878:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385358848 00000100:00100000:2.0:1789181632.871881:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385358848 00000100:00100000:2.0:1789181632.871892:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385359360 00000100:00100000:2.0:1789181632.871894:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385359360 00000100:00100000:2.0:1789181632.871908:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1789181632.871913:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e00f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385358720:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181632.871940:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e00f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385358720:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181632.871954:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1789181632.872082:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1789181632.872089:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2394:x1876092385359232:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181632.872112:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2394:x1876092385359232:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181632.872118:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:2.0:1789181632.872129:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1789181632.872134:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385358848:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181632.872156:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385358848:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181632.872162:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1789181632.872172:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1789181632.872177:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2394:x1876092385359360:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181632.872195:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2394:x1876092385359360:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 19us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181632.872200:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1789181632.872230:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385358336 00000100:00100000:2.0:1789181632.872233:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385358336 00000100:00100000:2.0:1789181632.872262:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:2.0:1789181632.872268:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+13:2394:x1876092385358336:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181632.872288:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7bec7f81-b22c-449b-9b54-80d117d39796+13:2394:x1876092385358336:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 21us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181632.872295:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00080000:2.0:1789181632.872336:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181632.872341:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181632.872343:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181632.872346:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789181633.035985:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181633.292167:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408513280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789181633.292260:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181633.292439:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408513280 00000100:00100000:2.0:1789181633.292462:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408513280 00000100:00100000:2.0:1789181633.292589:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181633.292600:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408513280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789181633.292635:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789181633.292692:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408513280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181633.292699:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789181633.292805:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181633.293091:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408513280:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789181634.059921:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181634.124412:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789181634.316099:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408513408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789181634.316174:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181634.316445:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408513792:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.316480:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181634.316502:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408514304:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.316523:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181634.316539:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408514816:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.316558:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181634.316577:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789181634.316583:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408513920:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.316602:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181634.316618:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408514432:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.316639:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181634.316655:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc4470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408514944:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.316674:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181634.316740:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408513792 00000100:00100000:2.0:1789181634.316749:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408513792 00000100:00100000:2.0:1789181634.316805:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408514304 00000100:00100000:2.0:1789181634.316808:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408514304 00000100:00100000:2.0:1789181634.316820:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408513920 00000100:00100000:2.0:1789181634.316822:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408513920 00000100:00100000:2.0:1789181634.316836:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789181634.316845:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408513792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.316902:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408513792:12345-0@lo:400:kworker.0 Request processed in 58us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181634.316911:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789181634.316929:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181634.316935:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408514304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.316961:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408514304:12345-0@lo:400:kworker.0 Request processed in 27us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181634.316967:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181634.316978:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789181634.316983:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408513920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.317008:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408513920:12345-0@lo:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181634.317013:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789181634.317033:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408514816 00000100:00100000:2.0:1789181634.317037:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408514816 00000100:00100000:2.0:1789181634.317064:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408514432 00000100:00100000:2.0:1789181634.317066:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408514432 00000100:00100000:2.0:1789181634.317076:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408514944 00000100:00100000:2.0:1789181634.317078:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408514944 00000100:00100000:2.0:1789181634.317090:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789181634.317096:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408514816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.317135:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408514816:12345-0@lo:400:kworker.0 Request processed in 40us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181634.317142:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789181634.317154:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789181634.317159:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408514432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.317183:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408514432:12345-0@lo:400:kworker.0 Request processed in 24us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181634.317188:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789181634.317211:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789181634.317218:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408514944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.317241:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408514944:12345-0@lo:400:kworker.0 Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181634.317246:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789181634.317274:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181634.317278:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181634.317281:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181634.317283:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181634.317310:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408513920:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.317321:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408514432:0@lo:400:kworker.0 00010000:00080000:2.0:1789181634.317332:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1cc4470e00 x1876092408514944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181634.317342:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408514944:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.317351:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408513792:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.317358:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408514304:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.317377:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc4470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408514816:0@lo:400:kworker.0 00000100:00100000:0.0:1789181634.317709:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408513408 00000100:00100000:0.0:1789181634.317715:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408513408 00000100:00100000:0.0:1789181634.317785:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789181634.317792:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408513408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181634.317815:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789181634.317856:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876092408513408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181634.317870:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789181634.318003:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1876092408513408:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789181634.318077:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181634.318308:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408513536:0@lo:400:kworker.0 00000100:00100000:3.0:1789181634.318360:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181634.318396:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408514048:0@lo:400:kworker.0 00000100:00100000:3.0:1789181634.318421:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181634.318440:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408514560:0@lo:400:kworker.0 00000100:00100000:3.0:1789181634.318460:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181634.318476:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408515072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181634.318496:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181634.318514:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789181634.318520:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408513664:0@lo:400:kworker.0 00000100:00100000:3.0:1789181634.318544:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181634.318560:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408514176:0@lo:400:kworker.0 00000100:00100000:3.0:1789181634.318593:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181634.318612:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408514688:0@lo:400:kworker.0 00000100:00100000:3.0:1789181634.318630:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181634.318683:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408513536 00000100:00100000:3.0:1789181634.318688:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408513536 00000100:00100000:3.0:1789181634.318720:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789181634.319248:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408513664 00000100:00100000:1.0:1789181634.319254:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408513664 00000100:00100000:1.0:1789181634.319286:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408514176 00000100:00100000:1.0:1789181634.319289:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408514176 00000100:00100000:1.0:1789181634.319301:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789181634.319307:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408513664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181634.319358:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408513664:12345-0@lo:400:kworker.0 Request processed in 50us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181634.319365:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789181634.319381:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789181634.319387:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408514176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181634.319411:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876092408514176:12345-0@lo:400:kworker.0 Request processed in 25us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181634.319422:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789181634.319438:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408514048 00000100:00100000:1.0:1789181634.319442:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408514048 00000100:00100000:1.0:1789181634.319463:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408514560 00000100:00100000:1.0:1789181634.319466:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408514560 00000100:00100000:1.0:1789181634.319486:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408514688 00000100:00100000:1.0:1789181634.319489:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408514688 00000100:00100000:1.0:1789181634.319504:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789181634.319508:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408514048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181634.319532:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876092408514048:12345-0@lo:400:kworker.0 Request processed in 24us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181634.319536:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789181634.319545:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789181634.319548:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408514560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181634.319565:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876092408514560:12345-0@lo:400:kworker.0 Request processed in 17us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181634.319570:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789181634.319580:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789181634.319585:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408514688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181634.319609:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876092408514688:12345-0@lo:400:kworker.0 Request processed in 25us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181634.319615:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789181634.319653:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408515200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181634.319683:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181634.319712:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408515200 00000100:00100000:1.0:1789181634.319715:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408515200 00000100:00100000:1.0:1789181634.319775:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789181634.319781:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408515200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789181634.319807:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789181634.319842:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408515200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181634.319848:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789181634.319897:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408515200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789181634.319921:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408513664:0@lo:400:kworker.0 00000100:00100000:1.0:1789181634.319926:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1876092408514176:0@lo:400:kworker.0 00010000:00080000:1.0:1789181634.319934:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1de7cbfb80 x1876092408514688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181634.319940:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1876092408514688:0@lo:400:kworker.0 00000100:00100000:1.0:1789181634.319947:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876092408514048:0@lo:400:kworker.0 00000100:00100000:1.0:1789181634.319953:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1de7cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1876092408514560:0@lo:400:kworker.0 00000100:00100000:0.0:1789181634.321399:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408515072 00000100:00100000:0.0:1789181634.321407:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408515072 00000100:00100000:0.0:1789181634.321465:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181634.321474:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408515072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181634.321495:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789181634.321579:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408515072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (3070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181634.321585:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181634.321603:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181634.321616:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408515328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181634.321649:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181634.321711:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408515072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181634.321761:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408515328 00000100:00100000:0.0:1789181634.321766:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408515328 00000100:00100000:0.0:1789181634.321796:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789181634.321802:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc384a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408515328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181634.321812:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789181634.321855:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc384a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408515328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181634.321862:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789181634.321890:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408515328:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789181634.322122:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789181634.322128:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181634.323706:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408515456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789181634.324292:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181634.324425:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408515456 00000100:00100000:2.0:1789181634.324446:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408515456 00000100:00100000:2.0:1789181634.324503:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789181634.324512:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408515456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789181634.324556:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789181634.324906:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:3645:x1876092408513536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.325028:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408515456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 517us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181634.325036:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789181634.325246:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408515456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181634.325489:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:3645:x1876092408513536:12345-0@lo:400:kworker.0 Request processed in 590us (7127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181634.325498:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789181634.325908:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:868df35c-3970-416b-9e25-2e3d68c8633a:3645:1876092408513536:0@lo:400:kworker.0 00000100:00100000:2.0:1789181634.694599:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181634.694756:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385359488 00000100:00100000:1.0:1789181634.694769:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385359488 00000100:00100000:1.0:1789181634.694864:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1789181634.694874:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:15569:x1876092385359488:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181634.694895:0:19683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181634.694938:0:19683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb555283518693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8390 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695006:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351869a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695036:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351869a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695048:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351869a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695063:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695071:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695078:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695155:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835186a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695165:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835186a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695173:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835186a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181634.695225:0:19683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789181634.695230:0:19683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181634.695269:0:19683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835186a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695282:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351869a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695299:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351869a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695306:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351869a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695311:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181634.695385:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351869a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695395:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351869a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695410:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc7121300) 00010000:00010000:1.0:1789181634.695412:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181634.695418:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351869a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695425:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb55528351869a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695438:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695443:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695448:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695452:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13e00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181634.695463:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695469:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695476:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c1dd2b0c900) 00010000:00010000:1.0:1789181634.695479:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181634.695481:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695486:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695520:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb555283518693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8390 expref: 8 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695533:0:19683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12600/0x76fb5552835186a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8390 expref: 7 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.695540:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1dd2b0cc00) 00010000:00010000:1.0:1789181634.695542:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181634.695544:0:19683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12600, rc 0) 00000100:00100000:1.0:1789181634.695621:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:15569:x1876092385359488:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 747us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181634.695629:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00080000:2.0:1789181634.695770:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181634.703247:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181634.703956:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385359616 00000100:00100000:3.0:1789181634.703971:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385359616 00000100:00100000:3.0:1789181634.704234:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1789181634.704248:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:15569:x1876092385359616:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789181634.704366:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:15569:x1876092385359616:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 Request processed in 122us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181634.704374:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1789181634.715889:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181634.719649:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385359872 00000100:00100000:1.0:1789181634.719672:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385359872 00000100:00100000:1.0:1789181634.721350:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1789181634.721370:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:15569:x1876092385359872:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181634.721411:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181634.721436:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8397 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721519:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721535:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721547:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721592:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721600:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721607:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721767:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb5552835186c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721776:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb5552835186c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721783:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb5552835186c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181634.721794:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789181634.721956:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721965:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721972:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721979:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13e00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181634.721984:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.721993:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.722023:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c1dd2b0cc00) 00010000:00010000:1.0:1789181634.722027:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181634.723549:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.723573:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.723594:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.723599:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.723605:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.723630:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181634.723634:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.723642:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.723656:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c1dd2b0c900) 00010000:00010000:1.0:1789181634.723659:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181634.723662:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.723667:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.731683:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8397 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.731896:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13200/0x76fb5552835186c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8397 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.731907:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dd2b0ca00) 00010000:00010000:1.0:1789181634.731910:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181634.731914:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13200, rc 0) 00000100:00100000:1.0:1789181634.732515:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+9:15569:x1876092385359872:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 11146us (16633us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789181634.732526:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1789181634.750211:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181634.750438:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385360000 00000100:00100000:3.0:1789181634.750450:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385360000 00000100:00100000:3.0:1789181634.750518:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1789181634.750530:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+9:15569:x1876092385360000:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789181634.750651:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+9:15569:x1876092385360000:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 123us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181634.750659:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:0.0:1789181634.761082:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181634.761422:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385360128 00000100:00100000:2.0:1789181634.761435:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385360128 00000100:00100000:2.0:1789181634.761533:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:2.0:1789181634.761547:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:15569:x1876092385360128:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789181634.762675:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1789181634.764862:0:17147:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3249us 00000100:00100000:3.0:1789181634.811538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181634.811595:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385360256 00000100:00100000:0.0:1789181634.811607:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385360256 00000100:00100000:0.0:1789181634.811671:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:0.0:1789181634.811683:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+9:15575:x1876092385360256:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181634.811822:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181634.811843:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523800/0x76fb5552835186d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df839e expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.811969:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.811988:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812403:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812421:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb5552835186e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812430:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb5552835186e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812436:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb5552835186e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812496:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812503:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812507:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812512:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181634.812516:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812523:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812535:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc7121300) 00010000:00010000:2.0:1789181634.812537:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181634.812541:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812551:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812564:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb5552835186e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812568:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb5552835186e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812571:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb5552835186e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812575:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181634.812576:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb5552835186e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812580:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb5552835186e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812583:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1dc3bdaf00) 00010000:00010000:2.0:1789181634.812585:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181634.812586:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb5552835186e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812589:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb5552835186e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812620:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523800/0x76fb5552835186d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df839e expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812635:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc7121300) 00010000:00010000:2.0:1789181634.812636:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181634.812639:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523800/0x76fb5552835186d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df839e expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.812646:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523800, rc 0) 00000100:00100000:2.0:1789181634.812706:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+9:15575:x1876092385360256:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1025us (1179us total) trans 0 rc 301/301 00000100:00100000:2.0:1789181634.812715:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1789181634.818875:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:15569:x1876092385360128:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 57319us (57796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181634.818890:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1789181634.856778:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181634.856924:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385360384 00000100:00100000:0.0:1789181634.856937:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385360384 00000100:00100000:0.0:1789181634.857009:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:0.0:1789181634.857022:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+9:15575:x1876092385360384:12345-192.168.202.1@tcp:700:lfs.0 00000100:00100000:0.0:1789181634.857125:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+9:15575:x1876092385360384:12345-192.168.202.1@tcp:700:lfs.0 Request processed in 105us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181634.857133:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1789181634.865089:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181634.865199:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385360640 00000100:00100000:1.0:1789181634.865211:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385360640 00000100:00100000:1.0:1789181634.865285:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:1.0:1789181634.865297:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+9:15575:x1876092385360640:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:1.0:1789181634.865360:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181634.865390:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522400/0x76fb555283518600 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df830b expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.865415:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc7121300) 00010000:00010000:1.0:1789181634.865421:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181634.865492:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.865510:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df837b expref: 5 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.865520:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.865556:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df837b expref: 5 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.865572:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df837b expref: 5 pid: 17145 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181634.865586:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17145:1876092408515584:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181634.865695:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1d31240 going to sleep for 11 seconds 00000100:00100000:0.0:1789181634.886596:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181634.886752:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385360768 00000100:00100000:2.0:1789181634.886770:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385360768 00010000:00010000:2.0:1789181634.886821:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df837b expref: 6 pid: 17145 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181634.886851:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1789181634.886859:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2393:x1876092385360768:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181634.886875:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181634.886882:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df837b expref: 6 pid: 17145 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.886897:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df837b expref: 6 pid: 17145 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.886958:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc7121300) 00010000:00010000:2.0:1789181634.886964:0:17132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.886977:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.886985:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.887018:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181634.887340:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2393:x1876092385360768:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 478us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181634.887349:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00010000:00010000:1.0:1789181634.887882:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351863f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df837b expref: 5 pid: 17145 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181634.887918:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17145:1876092408515584:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181634.887961:0:17145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.887972:0:17145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.887978:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.888151:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.888162:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.888168:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789181634.889215:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789181634.891546:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.891569:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.891580:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181634.891598:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005579a552 reply state 00000000b9547f70 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.891622:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.891630:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:1.0:1789181634.891633:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789181634.891637:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789181634.891643:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789181634.891652:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.891659:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.891666:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.891672:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181634.891677:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.891685:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.891695:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc7121300) 00010000:00010000:1.0:1789181634.891698:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181634.891702:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.891709:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835186e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181634.892105:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005579a552 reply state 00000000b9547f70 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.892116:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181634.892122:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1dd2b0c900) 00010000:00010000:1.0:1789181634.892125:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789181634.892127:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789181634.892331:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+10:15575:x1876092385360640:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 27032us (27249us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789181634.892341:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:0.0:1789181634.983605:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181634.984375:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385360896 00000100:00100000:2.0:1789181634.984388:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385360896 00000100:00100000:2.0:1789181634.984458:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1789181634.984469:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+10:15583:x1876092385360896:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:2.0:1789181634.984497:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181634.984527:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83a5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.984606:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb555283518703 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.984621:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb555283518703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.984635:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb555283518703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181634.984702:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789181634.984706:0:17146:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181634.984870:0:17146:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb555283518703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.984899:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835186fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83a5 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.984919:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522c00/0x76fb555283518703 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83a5 expref: 11 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181634.984927:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3bdaf00) 00010000:00010000:2.0:1789181634.984930:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181634.984934:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1522c00, rc 0) 00000100:00100000:2.0:1789181634.985019:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+11:15583:x1876092385360896:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 550us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181634.985026:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:2.0:1789181635.028035:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181635.028200:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385361024 00000100:00100000:3.0:1789181635.028212:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385361024 00000100:00100000:3.0:1789181635.028606:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1789181635.028620:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:15584:x1876092385361024:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181635.028641:0:19683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181635.028664:0:19683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb55528351870a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83ac expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.028810:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b000/0x76fb555283518711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.028824:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b000/0x76fb555283518711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.028837:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b000/0x76fb555283518711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181635.028885:0:19683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789181635.028889:0:19683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181635.028913:0:19683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b000/0x76fb555283518711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.028938:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb55528351870a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83ac expref: 7 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.029130:0:19683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b000/0x76fb555283518711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83ac expref: 6 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.029162:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3bdaf00) 00010000:00010000:3.0:1789181635.029165:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181635.029169:0:19683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b000, rc 0) 00000100:00100000:3.0:1789181635.029377:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:15584:x1876092385361024:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 760us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181635.029384:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1789181635.032125:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.032213:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385361152 00000100:00100000:1.0:1789181635.032226:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385361152 00000100:00100000:1.0:1789181635.032386:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1789181635.032398:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:15584:x1876092385361152:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181635.032424:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181635.032446:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb555283518718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83b3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032517:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351871f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032531:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351871f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032543:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351871f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032573:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518726 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032580:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032586:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032850:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351872d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032859:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351872d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032866:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351872d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181635.032914:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789181635.032918:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181635.032936:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351872d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032950:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351871f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032957:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351871f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032964:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351871f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032980:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b12000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181635.032984:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351871f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.032992:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351871f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033015:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3bdaf00) 00010000:00010000:1.0:1789181635.033018:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181635.033023:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351871f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033029:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb55528351871f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033041:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033047:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518726 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033053:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033057:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0031600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181635.033060:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033066:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033085:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1dd2b0c900) 00010000:00010000:1.0:1789181635.033087:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181635.033090:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518726 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033096:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518726 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033125:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb555283518718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83b3 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033139:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351872d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83b3 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.033146:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:1.0:1789181635.033149:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181635.033152:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc0030800, rc 0) 00000100:00100000:1.0:1789181635.034214:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcc207df-596b-4f70-b3cc-6ce500b568a0+7:15584:x1876092385361152:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1808us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.034226:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:0.0:1789181635.043508:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.043611:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385361280 00000100:00100000:1.0:1789181635.043624:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385361280 00000100:00100000:1.0:1789181635.043700:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:1.0:1789181635.043711:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:15584:x1876092385361280:12345-192.168.202.1@tcp:900:lfs.0 00000100:00100000:1.0:1789181635.043853:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:15584:x1876092385361280:12345-192.168.202.1@tcp:900:lfs.0 Request processed in 143us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.043861:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00080000:0.0:1789181635.044279:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789181635.052281:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.052426:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385361536 00000100:00100000:1.0:1789181635.052438:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385361536 00000100:00100000:1.0:1789181635.052504:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1789181635.052517:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1de7cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcc207df-596b-4f70-b3cc-6ce500b568a0+7:15584:x1876092385361536:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181635.052539:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181635.052563:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83ba expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181635.052674:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789181635.052815:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518734 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83ba expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.052831:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3bdaf00) 00010000:00010000:1.0:1789181635.052834:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181635.052840:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83ba expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.052856:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc0031600, rc 0) 00000100:00100000:1.0:1789181635.052916:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1de7cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcc207df-596b-4f70-b3cc-6ce500b568a0+8:15584:x1876092385361536:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 402us (646us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789181635.052922:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1789181635.065020:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181635.065096:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385361792 00000100:00100000:3.0:1789181635.065107:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385361792 00000100:00100000:3.0:1789181635.065174:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1789181635.065219:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+8:15584:x1876092385361792:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:3.0:1789181635.065286:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181635.065326:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb55528351872d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83b3 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.065346:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:3.0:1789181635.065352:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181635.065376:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.065392:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.065401:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181635.065633:0:17146:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051454371 reply state 00000000617787ee transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.065659:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.065665:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:3.0:1789181635.065668:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789181635.065670:0:17146:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789181635.065679:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789181635.065810:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+9:15584:x1876092385361792:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 627us (804us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789181635.065817:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:0.0:1789181635.067406:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181635.067500:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385362048 00000100:00100000:2.0:1789181635.067510:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385362048 00000100:00100000:2.0:1789181635.067618:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1789181635.067631:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+9:15584:x1876092385362048:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1789181635.067894:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+10:15584:x1876092385362048:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 264us (495us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789181635.067916:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1789181635.072819:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.073078:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385362304 00000100:00100000:1.0:1789181635.073089:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385362304 00000100:00100000:1.0:1789181635.073156:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:1.0:1789181635.073168:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcc207df-596b-4f70-b3cc-6ce500b568a0+10:15584:x1876092385362304:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:1.0:1789181635.073202:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181635.073269:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83c1 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073363:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb555283518750 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073379:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb555283518750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073392:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb555283518750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073405:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518757 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073413:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073420:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181635.073526:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789181635.073600:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb555283518750 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073609:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb555283518750 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073615:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb555283518750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073621:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0030c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181635.073625:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb555283518750 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073643:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb555283518750 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073654:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3bdaf00) 00010000:00010000:1.0:1789181635.073657:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181635.073662:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb555283518750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073669:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb555283518750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073683:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073689:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518757 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073694:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073699:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0030800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181635.073702:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073708:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518757 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073715:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1dd2b0c900) 00010000:00010000:1.0:1789181635.073717:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181635.073720:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518757 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073784:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518757 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073820:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518749 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c1 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073830:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3bdaf00) 00010000:00010000:1.0:1789181635.073833:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181635.073837:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb555283518749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c1 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.073846:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc0031600, rc 0) 00000100:00100000:1.0:1789181635.073906:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcc207df-596b-4f70-b3cc-6ce500b568a0+11:15584:x1876092385362304:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 741us (1095us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789181635.074240:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1789181635.076231:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181635.076376:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385362432 00000100:00100000:2.0:1789181635.076385:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385362432 00000100:00100000:2.0:1789181635.076465:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:2.0:1789181635.076474:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+11:15584:x1876092385362432:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181635.076496:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181635.076513:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523200/0x76fb555283518765 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83c8 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.076602:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.076614:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.076622:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181635.076642:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789181635.076645:0:17146:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789181635.076658:0:17146:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.076678:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523200/0x76fb555283518765 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c8 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.076690:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c8 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.076712:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:2.0:1789181635.076714:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181635.076716:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523a00, rc 0) 00000100:00100000:2.0:1789181635.076804:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+12:15584:x1876092385362432:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 332us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181635.076809:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1789181635.080362:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181635.082056:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385362560 00000100:00100000:2.0:1789181635.082072:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385362560 00000100:00100000:3.0:1789181635.082283:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1789181635.082295:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcc207df-596b-4f70-b3cc-6ce500b568a0+12:15584:x1876092385362560:12345-192.168.202.1@tcp:37:lfs.0 00010000:00010000:0.0:1789181635.084591:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181635.089282:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcc207df-596b-4f70-b3cc-6ce500b568a0+12:15584:x1876092385362560:12345-192.168.202.1@tcp:37:lfs.0 Request processed in 6972us (8916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181635.089297:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1789181635.093023:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181635.093156:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385362816 00000100:00100000:2.0:1789181635.093167:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385362816 00000100:00100000:2.0:1789181635.093236:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1789181635.093246:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb1ccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+12:15584:x1876092385362816:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:2.0:1789181635.093499:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb1ccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+13:15584:x1876092385362816:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 253us (486us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789181635.093507:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1789181635.133276:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181635.133480:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385362944 00000100:00100000:3.0:1789181635.133494:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385362944 00000100:00100000:3.0:1789181635.133571:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1789181635.133582:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+11:15590:x1876092385362944:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1789181635.133606:0:19683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181635.133628:0:19683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb555283518773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83cf expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.133697:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb55528351877a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.133712:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb55528351877a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.133744:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb55528351877a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.133770:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb555283518781 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.133778:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb555283518781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.133785:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb555283518781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.133874:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658be00/0x76fb555283518788 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.133885:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658be00/0x76fb555283518788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.133893:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658be00/0x76fb555283518788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181635.133931:0:19683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789181635.133936:0:19683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789181635.134253:0:19683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658be00/0x76fb555283518788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134270:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb55528351877a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134277:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb55528351877a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134284:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb55528351877a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134301:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658aa00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181635.134305:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb55528351877a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134313:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb55528351877a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134411:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3bdaf00) 00010000:00010000:3.0:1789181635.134415:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181635.134421:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb55528351877a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134428:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb55528351877a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134443:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb555283518781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134449:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb555283518781 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134454:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb555283518781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134460:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658a600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181635.134580:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb555283518781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134587:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb555283518781 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134606:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1dd2b0c900) 00010000:00010000:3.0:1789181635.134608:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181635.134612:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb555283518781 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134618:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb555283518781 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134649:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb555283518773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83cf expref: 13 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134664:0:19683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658be00/0x76fb555283518788 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83cf expref: 12 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.134671:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:3.0:1789181635.134674:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789181635.134676:0:19683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658be00, rc 0) 00000100:00100000:3.0:1789181635.134857:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+12:15590:x1876092385362944:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1276us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181635.134866:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1789181635.137558:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.137674:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385363072 00000100:00100000:1.0:1789181635.137684:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385363072 00000100:00100000:1.0:1789181635.137812:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1789181635.137824:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:15590:x1876092385363072:12345-192.168.202.1@tcp:900:bash.0 00000100:00100000:1.0:1789181635.137925:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:15590:x1876092385363072:12345-192.168.202.1@tcp:900:bash.0 Request processed in 103us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.137934:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1789181635.141592:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.141685:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385363328 00000100:00100000:1.0:1789181635.141697:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385363328 00000100:00100000:1.0:1789181635.141830:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1789181635.141840:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+12:15590:x1876092385363328:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181635.141889:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181635.141914:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb55528351878f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83d6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.142045:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.142062:0:17147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c8 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.142073:0:17147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.142120:0:17147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c8 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.142133:0:17147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c8 expref: 12 pid: 17146 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181635.142147:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17147:1876092408515712:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181635.142245:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd9394900 going to sleep for 11 seconds 00000100:00100000:2.0:1789181635.145632:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181635.146781:0:18676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385363456 00000100:00100000:3.0:1789181635.146794:0:18676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385363456 00010000:00010000:3.0:1789181635.146844:0:18676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c8 expref: 13 pid: 17146 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181635.146994:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:3.0:1789181635.147006:0:18676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+13:2393:x1876092385363456:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181635.147043:0:18676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181635.147050:0:18676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c8 expref: 13 pid: 17146 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.147066:0:18676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c8 expref: 13 pid: 17146 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.147100:0:18676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:3.0:1789181635.147106:0:18676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.147117:0:18676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.147126:0:18676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.147147:0:18676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181635.147220:0:18676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+13:2393:x1876092385363456:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 216us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181635.147227:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00010000:00010000:1.0:1789181635.147432:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351876c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83c8 expref: 12 pid: 17146 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181635.147451:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17147:1876092408515712:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181635.147616:0:17147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.147637:0:17147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.147644:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.147669:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.147679:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.147686:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.149792:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.149815:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.149826:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181635.149839:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789181635.149873:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.149879:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.150015:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.150035:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0030800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181635.150039:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.150047:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.150060:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:1.0:1789181635.150063:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181635.150068:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.150074:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb555283518796 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181635.150098:0:17147:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ff45c9d reply state 00000000730ee8ab transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.150110:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.150117:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c1dd2b0c700) 00010000:00010000:1.0:1789181635.150119:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789181635.150123:0:17147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789181635.150162:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb55528351878f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83d6 expref: 15 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.150179:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83d6 expref: 14 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.150208:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181635.150211:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789181635.150213:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b13600, rc 0) 00000100:00100000:1.0:1789181635.150304:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+15:15590:x1876092385363328:12345-192.168.202.1@tcp:101:bash.0 Request processed in 8464us (8723us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789181635.150755:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000040:00080000:0.0:1789181635.156482:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789181635.172196:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.175167:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385363584 00000100:00100000:1.0:1789181635.175197:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385363584 00000100:00100000:1.0:1789181635.175289:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:1.0:1789181635.175303:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+15:15590:x1876092385363584:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:1.0:1789181635.175530:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181635.175557:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb5552835187b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83dd expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.175650:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.175666:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.175678:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181635.175768:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789181635.175773:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181635.175797:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.175834:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.175861:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb5552835187b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83dd expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.176435:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83dd expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.176447:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181635.176450:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181635.176454:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc0031600, rc 0) 00000100:00100000:1.0:1789181635.176598:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+16:15590:x1876092385363584:12345-192.168.202.1@tcp:101:bash.0 Request processed in 1298us (4419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.176607:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:0.0:1789181635.182943:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181635.183086:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385363840 00000100:00100000:2.0:1789181635.183099:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385363840 00000100:00100000:2.0:1789181635.183204:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1789181635.183217:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+16:15590:x1876092385363840:12345-192.168.202.1@tcp:35:bash.0 00000100:00100000:2.0:1789181635.183612:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+17:15590:x1876092385363840:12345-192.168.202.1@tcp:35:bash.0 Request processed in 395us (743us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789181635.183620:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1789181635.289835:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181635.290083:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385364096 00000100:00100000:2.0:1789181635.290096:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385364096 00000100:00100000:2.0:1789181635.290160:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:2.0:1789181635.290168:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+17:15600:x1876092385364096:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1789181635.290203:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181635.290229:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb5552835187c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83e4 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181635.290348:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789181635.290456:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb5552835187c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83e4 expref: 19 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.290481:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c1dc3bdaf00) 00010000:00010000:2.0:1789181635.290484:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181635.290490:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb5552835187c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83e4 expref: 19 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.290510:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523c00, rc 0) 00000100:00100000:2.0:1789181635.290835:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+18:15600:x1876092385364096:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 665us (1008us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789181635.290843:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1789181635.293967:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181635.294071:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385364352 00000100:00100000:0.0:1789181635.294080:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385364352 00000100:00100000:0.0:1789181635.294124:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1789181635.294131:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+18:15600:x1876092385364352:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1789181635.294363:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+19:15600:x1876092385364352:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 232us (407us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789181635.294370:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1789181635.330563:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181635.330753:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385364608 00000100:00100000:3.0:1789181635.330764:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385364608 00000100:00100000:3.0:1789181635.330828:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:3.0:1789181635.330838:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+19:15603:x1876092385364608:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1789181635.330861:0:19683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181635.330899:0:19683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835187ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83eb expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.331168:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb5552835187d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.331182:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb5552835187d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.331360:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb5552835187d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181635.331371:0:19683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789181635.331483:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835187ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83eb expref: 22 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.331503:0:19683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb5552835187d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83eb expref: 21 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.331513:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:3.0:1789181635.331516:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181635.331519:0:19683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658a600, rc 0) 00000100:00100000:3.0:1789181635.331785:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+21:15603:x1876092385364608:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 886us (1173us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789181635.331794:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1789181635.338375:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181635.338480:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.338568:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385364864 00000100:00100000:1.0:1789181635.338579:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385364864 00000100:00100000:1.0:1789181635.338649:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1789181635.338661:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+21:15603:x1876092385364864:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:1.0:1789181635.338752:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.338772:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.338783:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.338854:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.338862:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.338869:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.338888:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0030800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181635.338892:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.338900:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.338914:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181635.338917:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181635.338923:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.338929:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181635.339016:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+21:15603:x1876092385364864:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 357us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.339025:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1789181635.342992:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.343296:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385365120 00000100:00100000:1.0:1789181635.343319:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385365120 00000100:00100000:1.0:1789181635.343374:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:1.0:1789181635.343403:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+21:15603:x1876092385365120:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1789181635.343691:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+22:15603:x1876092385365120:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 289us (711us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789181635.343699:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1789181635.349770:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385364736 00000100:00100000:2.0:1789181635.349792:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385364736 00000100:00100000:2.0:1789181635.349926:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1789181635.349939:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+22:2393:x1876092385364736:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181635.349972:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181635.350005:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a600/0x76fb5552835187d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83eb expref: 22 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.350044:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:2.0:1789181635.350049:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181635.350121:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+21:2393:x1876092385364736:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 185us (11811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181635.350129:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000040:00080000:0.0:1789181635.469345:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789181635.646335:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.646483:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385365376 00000100:00100000:1.0:1789181635.646494:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385365376 00000100:00100000:1.0:1789181635.646557:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:1.0:1789181635.646567:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+21:15635:x1876092385365376:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:1.0:1789181635.646592:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181635.646614:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83f2 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.646766:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb5552835187f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.646784:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb5552835187f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.646796:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb5552835187f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181635.646809:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789181635.647017:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030800/0x76fb5552835187ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83f2 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.647040:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb5552835187f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83f2 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.647071:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181635.647074:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181635.647079:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1de0b12000, rc 0) 00000100:00100000:1.0:1789181635.647274:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+23:15635:x1876092385365376:12345-192.168.202.1@tcp:101:cat.0 Request processed in 707us (947us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789181635.647281:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:3.0:1789181635.651564:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181635.651610:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.651693:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385365632 00000100:00100000:1.0:1789181635.651703:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385365632 00000100:00100000:1.0:1789181635.651804:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1789181635.651815:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+23:15635:x1876092385365632:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:1.0:1789181635.652122:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+24:15635:x1876092385365632:12345-192.168.202.1@tcp:35:cat.0 Request processed in 308us (570us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789181635.652130:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1789181635.652511:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385365760 00000100:00100000:2.0:1789181635.652519:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385365760 00000100:00100000:2.0:1789181635.652561:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1789181635.652569:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+24:2394:x1876092385365760:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181635.652581:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181635.652606:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b12000/0x76fb5552835187f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83f2 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.652623:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:2.0:1789181635.652627:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181635.652666:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+23:2394:x1876092385365760:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 97us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181635.652674:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1789181635.708932:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.709055:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385366016 00000100:00100000:1.0:1789181635.709067:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385366016 00000100:00100000:1.0:1789181635.709130:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:1.0:1789181635.709140:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+23:15641:x1876092385366016:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1789181635.709166:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181635.709203:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb5552835187ff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df83f9 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.709319:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.709336:0:17147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83d6 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.709361:0:17147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83dd expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.709370:0:17147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.709405:0:17147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83dd expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.709421:0:17147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83dd expref: 24 pid: 17145 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181635.709436:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc320a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17147:1876092408515840:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181635.709624:0:17147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83d6 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.709634:0:17147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83d6 expref: 24 pid: 17147 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181635.709643:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17147:1876092408515968:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181635.709667:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd9394600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181635.712576:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181635.712668:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385366144 00000100:00100000:0.0:1789181635.712678:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385366144 00010000:00010000:0.0:1789181635.712719:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83dd expref: 25 pid: 17145 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181635.712799:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:0.0:1789181635.712810:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+25:2394:x1876092385366144:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181635.712826:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181635.712832:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83dd expref: 25 pid: 17145 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181635.712845:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83dd expref: 25 pid: 17145 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181635.712885:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:0.0:1789181635.712891:0:17132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181635.712901:0:17132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181635.712908:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181635.712982:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+25:2394:x1876092385366144:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 174us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181635.712990:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00010000:00010000:2.0:1789181635.713854:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0031600/0x76fb5552835187b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83dd expref: 24 pid: 17145 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181635.713875:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc320a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17147:1876092408515840:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181635.713889:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17147:1876092408515968:192.168.202.1@tcp:104: 00010000:00010000:2.0:1789181635.713913:0:17147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181635.714857:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181635.714986:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385366272 00000100:00100000:2.0:1789181635.714995:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385366272 00010000:00010000:2.0:1789181635.715030:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83d6 expref: 24 pid: 17147 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181635.715065:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1789181635.715075:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dff941850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+24:2393:x1876092385366272:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181635.715089:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181635.715095:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83d6 expref: 24 pid: 17147 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.715107:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83d6 expref: 24 pid: 17147 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.715125:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13600/0x76fb5552835187a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83d6 expref: 24 pid: 17147 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.715138:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:2.0:1789181635.715142:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.715150:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.715158:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.715196:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181635.715254:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dff941850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+23:2393:x1876092385366272:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 179us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181635.715261:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:1.0:1789181635.715366:0:17147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.715376:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181635.715399:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789181635.715548:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb5552835187ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83f9 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.715562:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084bc00/0x76fb555283518806 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df83f9 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.715569:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181635.715572:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789181635.715574:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084bc00, rc 0) 00000100:00100000:1.0:1789181635.715598:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+23:15641:x1876092385366016:12345-192.168.202.1@tcp:101:dd.0 Request processed in 6460us (6676us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789181635.715604:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1789181635.721692:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.721812:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385366400 00000100:00100000:1.0:1789181635.721825:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385366400 00000100:00100000:1.0:1789181635.721894:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1789181635.721904:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+23:15641:x1876092385366400:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1789181635.721930:0:19683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181635.721959:0:19683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518814 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8400 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.722001:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.722015:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.722050:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.722193:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518814 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8400 expref: 25 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.722209:0:19683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8400 expref: 24 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.722218:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181635.722221:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789181635.722225:0:19683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084a200, rc 0) 00000100:00100000:1.0:1789181635.722290:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+24:15641:x1876092385366400:12345-192.168.202.1@tcp:101:dd.0 Request processed in 386us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.722297:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1789181635.725549:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181635.725634:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385366656 00000100:00100000:3.0:1789181635.725644:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385366656 00000100:00100000:3.0:1789181635.725702:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:3.0:1789181635.725712:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+24:15641:x1876092385366656:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:3.0:1789181635.725987:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.726008:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.726019:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181635.726070:0:17146:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789181635.726095:0:17146:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eea5471c reply state 00000000c49c2756 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.726108:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181635.726116:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:3.0:1789181635.726119:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789181635.726124:0:17146:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181635.726537:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+27:15641:x1876092385366656:12345-192.168.202.1@tcp:36:dd.0 Request processed in 822us (994us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789181635.726545:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000020:00080000:3.0:1789181635.726551:0:17146:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789181635.730167:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181635.730361:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385366784 00000100:00100000:1.0:1789181635.730373:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385366784 00000100:00100000:1.0:1789181635.730488:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:1.0:1789181635.730499:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+27:15641:x1876092385366784:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:1.0:1789181635.730526:0:19683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181635.730549:0:19683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ae00/0x76fb555283518829 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8407 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.730608:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ae00/0x76fb555283518829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8407 expref: 28 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.730644:0:19683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ae00/0x76fb555283518829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8407 expref: 28 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181635.730665:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181635.730668:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181635.730671:0:19683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1e0084ae00, rc 0) 00000100:00100000:1.0:1789181635.730802:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+28:15641:x1876092385366784:12345-192.168.202.1@tcp:101:dd.0 Request processed in 305us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.730810:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1789181635.742875:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181635.743374:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385367040 00000100:00100000:2.0:1789181635.743384:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385367040 00000100:00100000:2.0:1789181635.743544:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:2.0:1789181635.743556:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+28:15641:x1876092385367040:12345-192.168.202.1@tcp:103:dd.0 00010000:00010000:2.0:1789181635.743572:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181635.743597:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ae00/0x76fb555283518829 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8407 expref: 28 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.743616:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:2.0:1789181635.743621:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181635.743681:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+27:15641:x1876092385367040:12345-192.168.202.1@tcp:103:dd.0 Request processed in 128us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181635.743688:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1789181635.745430:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181635.745568:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385367168 00000100:00100000:0.0:1789181635.745576:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385367168 00000100:00100000:0.0:1789181635.745623:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:0.0:1789181635.745634:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+27:15641:x1876092385367168:12345-192.168.202.1@tcp:58:dd.0 00010000:00010000:0.0:1789181635.745776:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181635.745792:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181635.745801:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181635.747101:0:17147:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181635.747394:0:17147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789181635.747516:0:17147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789181635.747615:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+27:15641:x1876092385367168:12345-192.168.202.1@tcp:58:dd.0 Request processed in 1970us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.747626:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:3.0:1789181635.749085:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181635.749373:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385367296 00000100:00100000:2.0:1789181635.749382:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385367296 00000100:00100000:2.0:1789181635.749430:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:2.0:1789181635.749440:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+27:15641:x1876092385367296:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1789181635.749508:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181635.749530:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb555283518837 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df840e expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.749583:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.749593:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb555283518837 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df840e expref: 28 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.749619:0:17145:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.749632:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb555283518837 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df840e expref: 28 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.749646:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:2.0:1789181635.749649:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181635.749653:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb555283518837 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df840e expref: 28 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181635.749661:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523c00, rc 0) 00000100:00100000:2.0:1789181635.749779:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+28:15641:x1876092385367296:12345-192.168.202.1@tcp:101:dd.0 Request processed in 340us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181635.749786:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00010000:00010000:3.0:1789181636.108650:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181636.492551:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789181636.492561:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181636.492606:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789181636.492632:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789181636.492807:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc46bd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17179:1876092408516096:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789181636.493027:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1eb0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789181636.509202:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc46bd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17179:1876092408516096:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789181636.512534:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.514377:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385367424 00000100:00100000:2.0:1789181636.514396:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385367424 00000100:00100000:2.0:1789181636.514498:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:2.0:1789181636.514513:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+28:15642:x1876092385367424:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789181636.514551:0:17146:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1789181636.515410:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181636.515544:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+28:15642:x1876092385367424:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 1030us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.515556:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:3.0:1789181636.521186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181636.522399:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385367552 00000100:00100000:1.0:1789181636.522416:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385367552 00000100:00100000:1.0:1789181636.522591:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:1.0:1789181636.522613:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+28:15642:x1876092385367552:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789181636.523062:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb55528351883e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523081:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb55528351883e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523092:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb55528351883e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523166:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283518845 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523186:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283518845 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523193:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283518845 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523219:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523228:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523235:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181636.523429:0:19683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789181636.523435:0:19683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789181636.523450:0:19683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523533:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb55528351883e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523541:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb55528351883e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523548:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb55528351883e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523567:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084ac00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181636.523572:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb55528351883e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.523581:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb55528351883e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524212:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dd2b0ca00) 00010000:00010000:1.0:1789181636.524217:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181636.524225:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb55528351883e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524233:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb55528351883e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524249:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283518845 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524256:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283518845 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524262:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283518845 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524267:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181636.524269:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283518845 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524275:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283518845 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524432:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c1dd2b0c800) 00010000:00010000:1.0:1789181636.524436:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181636.524439:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283518845 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524446:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb555283518845 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524472:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524478:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524484:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524489:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b800 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181636.524492:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524498:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524505:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181636.524508:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181636.524510:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.524516:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b800/0x76fb55528351884c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181636.525213:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+28:15642:x1876092385367552:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 2595us (4037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181636.525224:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1789181636.531780:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.531891:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385367808 00000100:00100000:2.0:1789181636.531902:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385367808 00000100:00100000:2.0:1789181636.531960:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:2.0:1789181636.531983:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1e0093ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+28:15642:x1876092385367808:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181636.532004:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181636.532026:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb555283518853 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8415 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532128:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb55528351885a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532141:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb55528351885a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532151:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb55528351885a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181636.532159:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789181636.532239:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb55528351885a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532247:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb55528351885a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532253:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb55528351885a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532259:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1523600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:2.0:1789181636.532263:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb55528351885a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532271:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb55528351885a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532283:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:2.0:1789181636.532291:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789181636.532297:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb55528351885a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532304:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb55528351885a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532352:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb555283518853 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8415 expref: 30 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532363:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c1dd2b0ca00) 00010000:00010000:2.0:1789181636.532365:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181636.532369:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb555283518853 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8415 expref: 30 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.532379:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523a00, rc 0) 00000100:00100000:2.0:1789181636.532446:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1e0093ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+29:15642:x1876092385367808:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 463us (674us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789181636.532454:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1789181636.539343:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.539501:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385367936 00000100:00100000:2.0:1789181636.539514:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385367936 00000100:00100000:2.0:1789181636.539583:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1789181636.539595:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+29:15642:x1876092385367936:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789181636.539637:0:17145:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789181636.540100:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+29:15642:x1876092385367936:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 506us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.540108:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1789181636.550781:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181636.551047:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385368192 00000100:00100000:3.0:1789181636.551058:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385368192 00000100:00100000:3.0:1789181636.551126:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1789181636.551138:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+29:15642:x1876092385368192:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181636.551163:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181636.551197:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb555283518868 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df841c expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181636.552215:0:17146:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:3.0:1789181636.552223:0:17146:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1789181636.552244:0:17146:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:3.0:1789181636.552911:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351886f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.552928:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351886f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.553376:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351886f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.553460:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb555283518868 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df841c expref: 32 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.553481:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351886f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df841c expref: 31 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.553506:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1cc3740600) 00010000:00010000:3.0:1789181636.553509:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181636.553513:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b600, rc 0) 00000100:00100000:3.0:1789181636.553599:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+31:15642:x1876092385368192:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2463us (2876us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789181636.553609:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1789181636.566776:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181636.567495:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385368448 00000100:00100000:1.0:1789181636.567510:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385368448 00000100:00100000:1.0:1789181636.567579:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1789181636.567590:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+31:15642:x1876092385368448:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789181636.567704:0:19683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181636.567765:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b600/0x76fb55528351886f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df841c expref: 31 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.567784:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1cc3740600) 00010000:00010000:1.0:1789181636.567797:0:19683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181636.567822:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351887d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.567836:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351887d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.567847:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351887d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.567900:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518884 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbc2b6528 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.567908:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2b6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.567915:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2b6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.567989:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351887d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.567998:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351887d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568005:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351887d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568011:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181636.568015:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351887d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568023:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351887d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568031:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:1.0:1789181636.568034:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181636.568038:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351887d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568044:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb55528351887d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568055:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2b6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568060:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518884 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2b6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568066:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518884 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2b6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568079:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084ac00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181636.568082:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518884 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2b6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568087:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518884 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbc2b6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568094:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xbc2b6528 (ffff9c1dd2b0c800) 00010000:00010000:1.0:1789181636.568097:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181636.568099:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518884 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbc2b6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.568104:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084ac00/0x76fb555283518884 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbc2b6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181636.568203:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+30:15642:x1876092385368448:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 615us (1485us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181636.568209:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1789181636.570786:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.571370:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385368576 00000100:00100000:2.0:1789181636.571392:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385368576 00000100:00100000:2.0:1789181636.571505:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1789181636.571515:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+30:15642:x1876092385368576:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181636.571535:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181636.571561:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351888b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8423 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.571597:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb555283518892 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.571611:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb555283518892 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.571622:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb555283518892 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.571766:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523a00/0x76fb55528351888b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8423 expref: 32 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.571785:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523600/0x76fb555283518892 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8423 expref: 31 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.571793:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1dc3bda200) 00010000:00010000:2.0:1789181636.571796:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789181636.571799:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523600, rc 0) 00000100:00100000:2.0:1789181636.571872:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+31:15642:x1876092385368576:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 358us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.571879:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:0.0:1789181636.575254:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181636.575335:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385368832 00000100:00100000:1.0:1789181636.575346:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385368832 00000100:00100000:1.0:1789181636.575408:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:1.0:1789181636.575417:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+31:15642:x1876092385368832:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789181636.575516:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.575534:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.575561:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181636.575775:0:19683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1789181636.575786:0:19683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 592563061068ns, next at 593563058176ns, rc = 0 00000004:00010000:1.0:1789181636.575836:0:19683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a02709a7 reply state 000000001115b277 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.575849:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.575857:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1dc3bda200) 00010000:00010000:1.0:1789181636.575860:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789181636.575864:0:19683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789181636.575973:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+33:15642:x1876092385368832:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 555us (728us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789181636.575982:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1789181636.579829:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181636.579898:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385368960 00000100:00100000:3.0:1789181636.579908:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385368960 00000100:00100000:3.0:1789181636.580023:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1789181636.580035:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+33:15642:x1876092385368960:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181636.580060:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181636.580079:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835188a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df842a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.580210:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835188a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df842a expref: 34 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.580227:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835188a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df842a expref: 34 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.580246:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1dc3bda200) 00010000:00010000:3.0:1789181636.580250:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181636.580253:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658b400, rc 0) 00000100:00100000:3.0:1789181636.580407:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+34:15642:x1876092385368960:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 374us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181636.580427:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1789181636.583806:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181636.584018:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385369088 00000100:00100000:3.0:1789181636.584030:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385369088 00000100:00100000:3.0:1789181636.584089:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1789181636.584100:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc46bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2394:x1876092385369088:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789181636.584374:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181636.586032:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc46bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2394:x1876092385369088:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 1924us (2225us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789181636.586060:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1789181636.591617:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181636.591765:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385369344 00000100:00100000:0.0:1789181636.591775:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385369344 00000100:00100000:0.0:1789181636.591834:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1789181636.591845:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+34:15642:x1876092385369344:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789181636.592205:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+35:15642:x1876092385369344:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 332us (575us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789181636.592213:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1789181636.597542:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181636.597845:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385369600 00000100:00100000:3.0:1789181636.597857:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385369600 00000100:00100000:3.0:1789181636.597925:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1789181636.597945:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+35:15642:x1876092385369600:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789181636.598067:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+35:15642:x1876092385369600:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 133us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181636.598075:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:1.0:1789181636.606484:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181636.609874:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385369728 00000100:00100000:0.0:1789181636.609895:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385369728 00000100:00100000:0.0:1789181636.610102:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1789181636.610116:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+35:15642:x1876092385369728:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181636.610141:0:19683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181636.610165:0:19683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679200/0x76fb5552835188a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8431 expref: -99 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.610448:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835188ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.610478:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835188ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.610490:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835188ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181636.610534:0:19683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789181636.610552:0:19683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835188ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.610579:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679200/0x76fb5552835188a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8431 expref: 37 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.610596:0:19683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835188ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8431 expref: 36 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.610606:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1dc3bda200) 00010000:00010000:0.0:1789181636.610608:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789181636.610623:0:19683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1679c00, rc 0) 00000100:00100000:0.0:1789181636.610842:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+36:15642:x1876092385369728:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 729us (4376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181636.610849:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:3.0:1789181636.615894:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.616157:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385369856 00000100:00100000:2.0:1789181636.616169:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385369856 00000100:00100000:2.0:1789181636.616245:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1789181636.616255:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+6:2393:x1876092385369856:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181636.616272:0:18650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181636.616303:0:18650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb5552835188b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8438 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181636.616330:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4bec4, blocks: 0x0 00010000:00010000:2.0:1789181636.616350:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1789181636.616354:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181636.616364:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb5552835188b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8438 expref: 7 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.616383:0:18650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb5552835188b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8438 expref: 7 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.616397:0:18650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523a00, rc 0) 00000100:00100000:2.0:1789181636.616463:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:2393:x1876092385369856:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 209us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.616471:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1789181636.623230:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.623326:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385370112 00000100:00100000:2.0:1789181636.623336:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385370112 00000100:00100000:2.0:1789181636.623389:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:2.0:1789181636.623400:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+36:15642:x1876092385370112:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789181636.623574:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+36:15642:x1876092385370112:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 175us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.623583:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:0.0:1789181636.629122:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.629228:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385370240 00000100:00100000:2.0:1789181636.629239:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385370240 00000100:00100000:2.0:1789181636.629307:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1789181636.629318:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+36:15642:x1876092385370240:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789181636.647566:0:17125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1789181636.647587:0:17125:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789181636.647828:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647843:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647852:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647858:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181636.647863:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647890:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647908:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c1dd2b0c900) 00010000:00010000:3.0:1789181636.647911:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181636.647916:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647922:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13c00/0x76fb5552835186ee lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647956:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647963:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647968:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647972:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1de0b13e00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181636.647975:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647980:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.647988:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:3.0:1789181636.647990:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181636.647993:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648005:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1de0b13e00/0x76fb5552835186f5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648020:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648026:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648032:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648037:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc0030c00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181636.648040:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648047:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648054:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c1dd2b0c700) 00010000:00010000:3.0:1789181636.648057:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181636.648060:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648065:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc0030c00/0x76fb55528351879d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648080:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648087:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648099:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648104:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658aa00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181636.648106:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648112:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648122:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:3.0:1789181636.648124:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181636.648127:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648133:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb555283518822 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648143:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648149:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648154:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648158:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:3.0:1789181636.648161:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648190:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648200:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1dc3bda200) 00010000:00010000:3.0:1789181636.648202:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789181636.648206:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.648211:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb555283518899 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181636.650719:0:17125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1789181636.650804:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.650819:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.650827:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.650834:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc658ac00 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181636.650838:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.650860:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.650877:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c1dd2b0c000) 00010000:00010000:1.0:1789181636.650880:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789181636.650885:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.650891:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658ac00/0x76fb555283518742 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181636.651248:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+15:15642:x1876092385370240:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 21924us (22130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181636.651258:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:1.0:1789181636.657570:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408516224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789181636.657924:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181636.657969:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408516224 00000100:00100000:2.0:1789181636.657978:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408516224 00000100:00100000:2.0:1789181636.658054:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181636.658064:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876092408516224:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1789181636.658077:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789181636.658194:0:18978:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789181636.658198:0:18978:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789181636.658200:0:18978:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789181636.658202:0:18978:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789181636 -> 1789181636 00002000:00010000:2.0:1789181636.658204:0:18978:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789181636.658346:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876092408516224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 283us (688us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789181636.658354:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1789181636.658401:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c1cc37c4000/2, rc 0, transno 8589934596 00000100:00100000:0.0:1789181636.658408:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1876092408516224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789181636.662460:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.662586:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385370368 00000100:00100000:2.0:1789181636.662596:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385370368 00000100:00100000:2.0:1789181636.663080:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1789181636.663092:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:2394:x1876092385370368:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789181636.663255:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:2394:x1876092385370368:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 165us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.663263:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:1.0:1789181636.670802:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.670991:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385370624 00000100:00100000:2.0:1789181636.671002:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385370624 00000100:00100000:2.0:1789181636.671108:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:2.0:1789181636.671119:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc320b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+15:15642:x1876092385370624:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789181636.671184:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181636.671213:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679c00/0x76fb5552835188ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8431 expref: 15 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.671243:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1dc3bda200) 00010000:00010000:2.0:1789181636.671248:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181636.671288:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523200/0x76fb5552835188bc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.671489:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523200/0x76fb5552835188bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.671501:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523200/0x76fb5552835188bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181636.671645:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c956936d reply state 000000006824a117 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523200/0x76fb5552835188bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.671658:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523200/0x76fb5552835188bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.671665:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1dc3bda200) 00010000:00010000:2.0:1789181636.671681:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789181636.671684:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181636.671849:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc320b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+16:15642:x1876092385370624:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 732us (1265us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789181636.671857:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:0.0:1789181636.674579:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.674873:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385370752 00000100:00100000:2.0:1789181636.674885:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385370752 00000100:00100000:2.0:1789181636.675001:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1789181636.675014:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:15642:x1876092385370752:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181636.675039:0:18978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181636.675066:0:18978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df843f expref: -99 pid: 18978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.675112:0:18978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb5552835188b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8438 expref: 8 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.675122:0:18978:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181636.675127:0:18978:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181636.675132:0:18978:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 8 pid: 18978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.675170:0:18978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb5552835188b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8438 expref: 8 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.675195:0:18978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb5552835188b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8438 expref: 8 pid: 18650 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181636.675234:0:18978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:18978:1876092408516352:192.168.202.1@tcp:104: 00000100:00100000:2.0:1789181636.675410:0:18978:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd82bfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181636.681954:0:18978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:18978:1876092408516352:192.168.202.1@tcp:104: 00010000:00010000:3.0:1789181636.681997:0:18978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 8 pid: 18978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.682019:0:18978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc1523800, rc 0) 00000100:00100000:3.0:1789181636.682091:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+8:15642:x1876092385370752:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 7079us (7526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181636.682100:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1789181636.682237:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181636.684420:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385370880 00000100:00100000:3.0:1789181636.684438:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385370880 00010000:00010000:3.0:1789181636.684498:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb5552835188b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8438 expref: 8 pid: 18650 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181636.684570:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1789181636.684581:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+8:2394:x1876092385370880:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181636.684598:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181636.684635:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb5552835188b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8438 expref: 8 pid: 18650 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.684650:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb5552835188b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8438 expref: 8 pid: 18650 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.684677:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a38ebea9/0x76fb5552835188b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8438 expref: 8 pid: 18650 timeout: 692 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.684692:0:17130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181636.684696:0:17130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181636.684703:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 7 pid: 18978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.684712:0:17130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 7 pid: 18978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.684795:0:17130:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 7 pid: 18978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181636.684820:0:17130:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17130:1876092408516480:192.168.202.1@tcp:105: 00000100:00100000:3.0:1789181636.685232:0:17130:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd00c1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181636.691291:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.692061:0:17130:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc437aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17130:1876092408516480:192.168.202.1@tcp:105: 00010000:00010000:2.0:1789181636.692088:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181636.692164:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:2394:x1876092385370880:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 7583us (9926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.692185:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1789181636.692417:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385371008 00000100:00100000:1.0:1789181636.692427:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385371008 00000100:00100000:1.0:1789181636.692489:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:1.0:1789181636.692500:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc4379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:2393:x1876092385371008:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789181636.692708:0:18652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789181636.692712:0:18652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789181635 00002000:00010000:1.0:1789181636.692715:0:18652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789181634 00002000:00010000:1.0:1789181636.692717:0:18652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789181636 -> 1789181635 00002000:00010000:1.0:1789181636.692720:0:18652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789181636.692790:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc4379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+8:2393:x1876092385371008:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 291us (1509us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789181636.692796:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1789181636.698027:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181636.700597:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385371136 00000100:00100000:1.0:1789181636.700635:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385371136 00000100:00100000:1.0:1789181636.700718:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1789181636.700774:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+8:2396:x1876092385371136:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789181636.700843:0:18653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.700867:0:18653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 8 pid: 18978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.700876:0:18653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181636.700880:0:18653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181636.700885:0:18653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.700940:0:18653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 8 pid: 18978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.700956:0:18653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 8 pid: 18978 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181636.700971:0:18653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18653:1876092408516608:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181636.701071:0:18653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1dd9394600 going to sleep for 11 seconds 00000100:00100000:0.0:1789181636.705218:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.705333:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385371264 00000100:00100000:2.0:1789181636.705345:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385371264 00010000:00010000:2.0:1789181636.705393:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 9 pid: 18978 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181636.705441:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1789181636.705453:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+9:2394:x1876092385371264:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181636.705469:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181636.705547:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 9 pid: 18978 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.705563:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 9 pid: 18978 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.705588:0:17131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181636.705603:0:17131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181636.705622:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.705633:0:17131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.705656:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181636.705822:0:18653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f908a90f/0x76fb5552835188c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df843f expref: 9 pid: 18978 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181636.705841:0:18653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18653:1876092408516608:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181636.705870:0:18653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.705881:0:18653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.705888:0:18653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.705907:0:18653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.705916:0:18653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.705923:0:18653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181636.705928:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+8:2394:x1876092385371264:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 477us (723us total) trans 0 rc 0/0 00010000:00010000:1.0:1789181636.705930:0:18653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a400 already unused, calling callback (ffffffffc0d949b0) 00000100:00100000:2.0:1789181636.705936:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00010000:00010000:1.0:1789181636.705946:0:18653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.705955:0:18653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.705967:0:18653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.705980:0:18653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb5552835188ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181636.706016:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:2396:x1876092385371136:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 5247us (8000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181636.706021:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:2.0:1789181636.707791:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1789181636.707870:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385371520 00000100:00100000:0.0:1789181636.707878:0:19683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385371520 00000100:00100000:0.0:1789181636.707942:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:0.0:1789181636.707950:0:19683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dd8ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+16:15642:x1876092385371520:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789181636.708019:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.708033:0:19683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8400 expref: 16 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.708038:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.708064:0:19683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8400 expref: 16 pid: 19683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.708077:0:19683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8400 expref: 16 pid: 19683 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181636.708092:0:19683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19683:1876092408516736:192.168.202.1@tcp:104: 00000100:00100000:0.0:1789181636.708159:0:19683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1eb0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181636.711552:0:19683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19683:1876092408516736:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181636.711578:0:19683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181636.711634:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.711801:0:18676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385371648 00000100:00100000:2.0:1789181636.711808:0:18676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385371648 00010000:00010000:2.0:1789181636.711839:0:18676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8400 expref: 17 pid: 19683 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181636.711916:0:18676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1789181636.711927:0:18676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+17:2393:x1876092385371648:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181636.711953:0:18676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181636.711960:0:18676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8400 expref: 17 pid: 19683 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.711970:0:18676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8400 expref: 17 pid: 19683 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.711987:0:18676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a200/0x76fb55528351881b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8400 expref: 17 pid: 19683 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.712014:0:18676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:2.0:1789181636.712018:0:18676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb555283518837 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df840e expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.712025:0:18676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.712030:0:18676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.712036:0:18676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.712055:0:18676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181636.712075:0:19683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.712082:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181636.712118:0:18676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+16:2393:x1876092385371648:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 193us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.712125:0:18676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00010000:00010000:1.0:1789181636.713363:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.713385:0:19683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835188a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df842a expref: 16 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.713391:0:19683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.713424:0:19683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835188a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df842a expref: 16 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.713448:0:19683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835188a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df842a expref: 16 pid: 17146 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181636.713461:0:19683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19683:1876092408516864:192.168.202.1@tcp:104: 00000100:00100000:1.0:1789181636.713546:0:19683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc30420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181636.715892:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1789181636.715910:0:19683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19683:1876092408516864:192.168.202.1@tcp:104: 00010000:00010000:1.0:1789181636.715939:0:19683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181636.716009:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385371776 00000100:00100000:2.0:1789181636.716017:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385371776 00010000:00010000:2.0:1789181636.716050:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835188a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df842a expref: 17 pid: 17146 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181636.716089:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1789181636.716099:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+17:2393:x1876092385371776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181636.716115:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181636.716122:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835188a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df842a expref: 17 pid: 17146 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.716154:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835188a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df842a expref: 17 pid: 17146 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.716190:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658b400/0x76fb5552835188a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x7a80027d91df842a expref: 17 pid: 17146 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.716210:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1dc3bda200) 00010000:00010000:2.0:1789181636.716216:0:17132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.716230:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.716240:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.716270:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181636.716337:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5862b8c-2b27-4ce8-9320-ff219707bd0a+16:2393:x1876092385371776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 238us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.716344:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:1.0:1789181636.716441:0:19683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.716447:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789181636.716594:0:19683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1789181636.716706:0:19683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789181636.716781:0:19683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1789181636.716848:0:19683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19683:1876092408516992:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789181636.716893:0:19683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181636.716918:0:19683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e41b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181636.717276:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408516992 00000100:00100000:2.0:1789181636.717283:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408516992 00000100:00100000:2.0:1789181636.717540:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789181636.717550:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19683:x1876092408516992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789181636.717654:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19683:x1876092408516992:12345-0@lo:1000:mdt00_003.0 Request processed in 106us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.717662:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789181636.717769:0:19683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19683:1876092408516992:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789181636.718100:0:19683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789181636.718146:0:19683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19683:1876092408517120:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789181636.718195:0:19683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181636.718248:0:19683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1cc1eb0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181636.718289:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408517120 00000100:00100000:2.0:1789181636.718357:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408517120 00000100:00100000:2.0:1789181636.718430:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789181636.718439:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:19683:x1876092408517120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789181636.718611:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:19683:x1876092408517120:12345-0@lo:1000:mdt00_003.0 Request processed in 173us (416us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789181636.718619:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789181636.718680:0:19683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19683:1876092408517120:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789181636.718715:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718839:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718859:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718865:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084b000 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181636.718870:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718879:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718893:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1dc3bda200) 00010000:00010000:1.0:1789181636.718897:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181636.718901:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718907:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084b000/0x76fb5552835188d8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718950:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718957:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718963:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718969:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1678600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181636.718972:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718988:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.718997:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181636.718999:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181636.719006:0:19683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb555283518837 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df840e expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.719018:0:19683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb555283518837 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df840e expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.719027:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb555283518837 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df840e expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.719079:0:19683:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1523c00/0x76fb555283518837 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df840e expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181636.719090:0:19683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19683:1876092408517248:192.168.202.1@tcp:105: 00000100:00100000:1.0:1789181636.719157:0:19683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c1de7e413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181636.722283:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.722587:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385371904 00000100:00100000:2.0:1789181636.722597:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385371904 00000100:00100000:2.0:1789181636.722656:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1789181636.722668:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb1cdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+20:15641:x1876092385371904:12345-192.168.202.1@tcp:49:dd.0 00000100:00100000:2.0:1789181636.722822:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb1cdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+20:15641:x1876092385371904:12345-192.168.202.1@tcp:49:dd.0 Request processed in 156us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181636.722830:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1789181636.723476:0:19683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3208000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19683:1876092408517248:192.168.202.1@tcp:105: 00010000:00010000:1.0:1789181636.723504:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723515:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1678600/0x76fb555283518830 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723557:0:19683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835188df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723593:0:19683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835188df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723605:0:19683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835188df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723616:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835188df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723621:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835188df lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723627:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835188df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723633:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a400 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181636.723637:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835188df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723644:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835188df lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723655:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181636.723659:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181636.723663:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835188df lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723670:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1e0084a400/0x76fb5552835188df lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723679:0:19683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723692:0:19683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723699:0:19683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723704:0:19683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1679600 already unused, calling callback (ffffffffc19bb4f0) 00010000:00010000:1.0:1789181636.723707:0:19683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723713:0:19683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723775:0:19683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:1.0:1789181636.723778:0:19683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789181636.723781:0:19683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.723787:0:19683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1679600/0x76fb5552835188d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181636.723988:0:19683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dd8ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+19:15642:x1876092385371520:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 16036us (16202us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789181636.723997:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000020:00080000:1.0:1789181636.724002:0:19683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789181636.724273:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789181636.724278:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181636.724295:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789181636.724301:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789181636.728379:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.728480:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385372160 00000100:00100000:2.0:1789181636.728491:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385372160 00000100:00100000:2.0:1789181636.728549:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1789181636.728560:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+19:15642:x1876092385372160:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789181636.728870:0:17148:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789181636.728907:0:17148:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789181636.728957:0:17148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.728974:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.728984:0:17148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.729011:0:17148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.729019:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.729025:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.729042:0:17148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789181636.729131:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+21:15642:x1876092385372160:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 573us (762us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789181636.729139:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000020:00080000:2.0:1789181636.729143:0:17148:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789181636.729585:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181636.729593:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.729601:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:0.0:1789181636.729605:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.729612:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.729625:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c1dc3bda200) 00010000:00010000:0.0:1789181636.729628:0:17133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789181636.729633:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.729639:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc1522600/0x76fb5552835188e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181636.729653:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181636.729655:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181636.729657:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181636.732329:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181636.732412:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385372288 00000100:00100000:3.0:1789181636.732423:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385372288 00000100:00100000:3.0:1789181636.732489:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:3.0:1789181636.732501:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+21:15641:x1876092385372288:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1789181636.732524:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181636.732545:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb5552835188ed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a80027d91df8446 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.732583:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a200/0x76fb5552835188f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.732597:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a200/0x76fb5552835188f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.732609:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a200/0x76fb5552835188f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.732764:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658aa00/0x76fb5552835188ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8446 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.732797:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c1dc658a200/0x76fb5552835188f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x7a80027d91df8446 expref: 22 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181636.732805:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c1dd2b0c400) 00010000:00010000:3.0:1789181636.732808:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789181636.732811:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c1dc658a200, rc 0) 00000100:00100000:3.0:1789181636.732866:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+22:15641:x1876092385372288:12345-192.168.202.1@tcp:101:dd.0 Request processed in 368us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181636.732874:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:1.0:1789181636.944891:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.945026:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385372416 00000100:00100000:2.0:1789181636.945038:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385372416 00000100:00100000:2.0:1789181636.945124:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1789181636.945137:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:2395:x1876092385372416:12345-192.168.202.1@tcp:4:dd.0 00002000:00010000:2.0:1789181636.945207:0:18656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa4bec3, atime: 0x6aa4bec2, ctime: 0x6aa4bec3, blocks: 0x0 00010000:00010000:2.0:1789181636.945219:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb5552835188fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.945240:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1789181636.945245:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181636.945252:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb5552835188fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181636.945269:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb5552835188fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181636.953455:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181636.955391:0:18658:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789181636.955412:0:18658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789181636.955926:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385372544 00000100:00100000:2.0:1789181636.955941:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385372544 00000100:00100000:1.0:1789181636.961006:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1789181636.961028:0:20285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+9:2395:x1876092385372544:12345-192.168.202.1@tcp:4:dd.0 00010000:00010000:1.0:1789181636.961077:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb555283518902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.961103:0:20285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181636.961108:0:20285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181636.961114:0:20285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb555283518902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181636.961128:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb555283518902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181637.110548:0:18647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1789181637.110568:0:18647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1789181637.113501:0:18656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1789181637.113516:0:18656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789181635 -> 1789181636 00002000:00010000:1.0:1789181637.113519:0:18656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789181635 -> 1789181636 00002000:00010000:1.0:1789181637.113521:0:18656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1789181637.113541:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb5552835188fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.113555:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb5552835188fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.113564:0:18656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb5552835188fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.113572:0:18656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1dc1522600 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:1.0:1789181637.113577:0:18656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb5552835188fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.113586:0:18656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb5552835188fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.113828:0:18656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb5552835188fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.113836:0:18656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02e4907/0x76fb5552835188fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181637.114319:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5862b8c-2b27-4ce8-9320-ff219707bd0a+7:2395:x1876092385372416:12345-192.168.202.1@tcp:4:dd.0 Request processed in 169178us (169433us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789181637.114331:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00010000:00010000:0.0:1789181637.134553:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789181637.138472:0:18647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1789181637.138748:0:20285:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1789181637.138753:0:20285:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1789181637.138776:0:20285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb555283518902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181637.138789:0:20285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb555283518902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181637.138798:0:20285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb555283518902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181637.138805:0:20285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c1e0084a400 already unused, calling callback (ffffffffc0d949b0) 00010000:00010000:2.0:1789181637.138810:0:20285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb555283518902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181637.138818:0:20285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb555283518902 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181637.138839:0:20285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb555283518902 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181637.138865:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2e99dae/0x76fb555283518902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181637.139002:0:20285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2395:x1876092385372544:12345-192.168.202.1@tcp:4:dd.0 Request processed in 177971us (185553us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789181637.139015:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1789181637.989703:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1789181637.992117:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385372672 00000100:00100000:2.0:1789181637.992133:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385372672 00000100:00100000:2.0:1789181637.992219:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:2.0:1789181637.992230:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+13:2394:x1876092385372672:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1789181637.992335:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7bec7f81-b22c-449b-9b54-80d117d39796+13:2394:x1876092385372672:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 107us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181637.992344:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 169 00000100:00100000:3.0:1789181637.999471:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181637.999528:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181637.999557:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181637.999588:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181637.999608:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181637.999638:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385372800 00000100:00100000:3.0:1789181637.999649:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385372800 00000100:00100000:3.0:1789181637.999698:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385373312 00000100:00100000:3.0:1789181637.999702:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385373312 00000100:00100000:3.0:1789181637.999760:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385372928 00000100:00100000:3.0:1789181637.999763:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385372928 00000100:00100000:3.0:1789181637.999783:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1789181637.999793:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dc437aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+22:2393:x1876092385372800:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181637.999880:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dc437aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+22:2393:x1876092385372800:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 88us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181637.999889:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 72 00000100:00100000:3.0:1789181637.999908:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:3.0:1789181637.999945:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2393:x1876092385373312:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181637.999975:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+6:2393:x1876092385373312:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181637.999981:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 73 00000100:00100000:3.0:1789181637.999996:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1789181638.000003:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2393:x1876092385372928:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181638.000027:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2393:x1876092385372928:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181638.000033:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00080000:3.0:1789181638.000052:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181638.000068:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181638.000096:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181638.000153:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181638.000197:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1789181638.000282:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385373056 00000100:00100000:3.0:1789181638.000286:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385373056 00000100:00100000:3.0:1789181638.000305:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385373568 00000100:00100000:3.0:1789181638.000308:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385373568 00000100:00100000:3.0:1789181638.000326:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385373184 00000100:00100000:3.0:1789181638.000328:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385373184 00000100:00100000:3.0:1789181638.000338:0:18978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385373696 00000100:00100000:3.0:1789181638.000340:0:18978:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385373696 00000100:00100000:3.0:1789181638.000352:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1789181638.000357:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2393:x1876092385373056:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181638.000386:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2393:x1876092385373056:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181638.000392:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1789181638.000409:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1789181638.000414:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2393:x1876092385373568:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181638.000433:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2393:x1876092385373568:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 19us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181638.000438:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:3.0:1789181638.000446:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1789181638.000451:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2393:x1876092385373184:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181638.000466:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5862b8c-2b27-4ce8-9320-ff219707bd0a+5:2393:x1876092385373184:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 15us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181638.000471:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1789181638.000479:0:18978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:3.0:1789181638.000483:0:18978:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2393:x1876092385373696:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181638.000499:0:18978:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2393:x1876092385373696:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 15us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181638.000504:0:18978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00080000:3.0:1789181638.000515:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181638.000517:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181638.000523:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092385373440 00000100:00100000:3.0:1789181638.000526:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092385373440 00000100:00100000:3.0:1789181638.000545:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1789181638.000550:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2393:x1876092385373440:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1789181638.000570:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcc207df-596b-4f70-b3cc-6ce500b568a0+5:2393:x1876092385373440:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181638.000576:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00080000:3.0:1789181638.000594:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789181638.157958:0:17897:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181638.412154:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408517376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789181638.412243:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181638.412344:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408517376 00000100:00100000:2.0:1789181638.412353:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408517376 00000100:00100000:2.0:1789181638.412420:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789181638.412443:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408517376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789181638.412475:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789181638.412543:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408517376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181638.412550:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789181638.412756:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181638.412794:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408517376:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1789181638.760307:0:20322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789181639.180392:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181639.436985:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181639.437011:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408517504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181639.437188:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181639.437652:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181639.437662:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc37c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408517632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789181639.437693:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181639.437750:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408517504 00000100:00100000:0.0:1789181639.437759:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408517504 00000100:00100000:0.0:1789181639.437805:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408517632 00000100:00100000:0.0:1789181639.437809:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408517632 00000100:00100000:0.0:1789181639.437825:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181639.437835:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408517504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181639.437856:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789181639.437898:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876092408517504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181639.437906:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181639.437924:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181639.437930:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc37c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408517632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789181639.437949:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789181639.437978:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc37c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408517632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181639.437984:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181639.438024:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408517632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789181639.438381:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408518016:0@lo:400:kworker.0 00000100:00100000:2.0:1789181639.438418:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181639.438445:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408518528:0@lo:400:kworker.0 00000100:00100000:2.0:1789181639.438468:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181639.438693:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408519040:0@lo:400:kworker.0 00000100:00100000:2.0:1789181639.438742:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181639.438762:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789181639.438767:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc3895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408518144:0@lo:400:kworker.0 00000100:00100000:2.0:1789181639.438790:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181639.438805:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408518656:0@lo:400:kworker.0 00000100:00100000:2.0:1789181639.438826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181639.438840:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408519168:0@lo:400:kworker.0 00000100:00100000:2.0:1789181639.438874:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181639.438906:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408519040 00000100:00100000:2.0:1789181639.438911:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408519040 00000100:00100000:2.0:1789181639.438947:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408518656 00000100:00100000:2.0:1789181639.438950:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408518656 00000100:00100000:2.0:1789181639.438962:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408519168 00000100:00100000:2.0:1789181639.438964:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408519168 00000100:00100000:2.0:1789181639.438979:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789181639.438986:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408519040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181639.439025:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876092408519040:12345-0@lo:400:kworker.0 Request processed in 41us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181639.439032:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789181639.439046:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789181639.439051:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408518656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181639.439654:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408518016 00000100:00100000:1.0:1789181639.439660:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408518016 00000100:00100000:1.0:1789181639.439694:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789181639.439702:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408518016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181639.439760:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408518016:12345-0@lo:400:kworker.0 Request processed in 60us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181639.439766:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789181639.439784:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408518528 00000100:00100000:1.0:1789181639.439787:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408518528 00000100:00100000:1.0:1789181639.439807:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408518144 00000100:00100000:1.0:1789181639.439810:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408518144 00000100:00100000:1.0:1789181639.439833:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789181639.439840:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1dfb2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408518528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181639.439872:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1dfb2a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876092408518528:12345-0@lo:400:kworker.0 Request processed in 32us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181639.439878:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789181639.439902:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789181639.439908:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc3ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408518144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181639.439937:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876092408518144:12345-0@lo:400:kworker.0 Request processed in 29us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181639.439942:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789181639.439980:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1789181639.439986:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c1cc37c4000, transno 8589934596 00000004:00080000:1.0:1789181639.439995:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1789181639.440022:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc37c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1876092408517504:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789181639.440561:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789181639.440565:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181639.440569:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181639.440571:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181639.440583:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408517888:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.440627:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.440661:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408518400:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.440682:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.440701:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc2f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408518912:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.440759:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.440771:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408519424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181639.440791:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.440812:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789181639.440818:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dd8ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408517760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181639.440840:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.440851:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dc4300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408518272:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.440866:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.440875:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408518784:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.440890:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.440912:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c1cc45ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408519296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181639.440933:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.440965:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408518912 00000100:00100000:3.0:1789181639.440970:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408518912 00000100:00100000:3.0:1789181639.441001:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408518272 00000100:00100000:3.0:1789181639.441004:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408518272 00000100:00100000:3.0:1789181639.441014:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408518784 00000100:00100000:3.0:1789181639.441016:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408518784 00000100:00100000:3.0:1789181639.441029:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789181639.441036:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc4d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408519168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441087:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc4d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876092408519168:12345-0@lo:400:kworker.0 Request processed in 50us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.441094:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789181639.441111:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789181639.441116:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408518912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441183:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876092408518912:12345-0@lo:400:kworker.0 Request processed in 66us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.441189:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789181639.441203:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789181639.441209:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408518272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441246:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876092408518272:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.441253:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789181639.441265:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789181639.441271:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408518784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441297:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876092408518784:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.441312:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789181639.441346:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408517888 00000100:00100000:3.0:1789181639.441350:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408517888 00000100:00100000:3.0:1789181639.441379:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789181639.441385:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1ddff81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:3646:x1876092408517888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441413:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1ddff81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:868df35c-3970-416b-9e25-2e3d68c8633a+24:3646:x1876092408517888:12345-0@lo:400:kworker.0 Request processed in 29us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.441418:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789181639.441445:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408518400 00000100:00100000:3.0:1789181639.441448:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408518400 00000100:00100000:3.0:1789181639.441463:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408519424 00000100:00100000:3.0:1789181639.441465:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408519424 00000100:00100000:3.0:1789181639.441472:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408517760 00000100:00100000:3.0:1789181639.441474:0:18162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408517760 00000100:00100000:3.0:1789181639.441484:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789181639.441490:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1876092408518400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441517:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1876092408518400:12345-0@lo:400:kworker.0 Request processed in 28us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.441523:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789181639.441534:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181639.441539:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408519424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789181639.441563:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789181639.441592:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876092408519424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.441598:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181639.441608:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789181639.441613:0:18162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408517760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789181639.441633:0:18162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789181639.441656:0:18162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408517760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.441662:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789181639.441679:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181639.441682:0:17141:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789181639.441713:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408517760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789181639.441745:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876092408518272:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441757:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1876092408518784:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441765:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:868df35c-3970-416b-9e25-2e3d68c8633a:3646:1876092408517888:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441775:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc4301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408518400:0@lo:400:kworker.0 00010000:00080000:3.0:1789181639.441787:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc2f05500 x1876092408518912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181639.441798:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1876092408518912:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441811:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1876092408519424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789181639.441878:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc3895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408518144:0@lo:400:kworker.0 00010000:00080000:3.0:1789181639.441890:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c1dc2f06300 x1876092408519168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181639.441900:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1876092408519168:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441910:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dd8ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1876092408518016:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441922:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1876092408518528:0@lo:400:kworker.0 00000100:00100000:3.0:1789181639.441942:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dc2f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1876092408519040:0@lo:400:kworker.0 00000100:00100000:2.0:1789181639.443602:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc3ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876092408518656:12345-0@lo:400:kworker.0 Request processed in 4542us (4766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181639.443615:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789181639.443687:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092408519296 00000100:00100000:2.0:1789181639.443694:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092408519296 00000100:00100000:2.0:1789181639.443750:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181639.443762:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c1cc45cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408519296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181639.443786:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789181639.443829:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c1cc45cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876092408519296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (2894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181639.443835:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181639.443881:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1cc45ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1876092408519296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181639.451679:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c1dff850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876092408518656:0@lo:400:kworker.0 00010000:00010000:0.0:1789181640.205974:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42936 lines, 42936 kept, 0 dropped, 0 bad.